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ABSTRACT 


This thesis presents an evaluation of three relatively simple reli- 
ability growth models for which accuracy, precision, and robustness per- 
formance were examined over a wide variety of true underlying reliability 
growth patterns. A continuous cumulative failure rate model, a continu- 
ous instantaneous failure rate model, and a discrete reliability model, 
each of which employ ordinary regression methods, were evaluated using 
standard computer Monte Carlo simulation techniques. Simple, straight- 
forward statistical measures of performance are exhibited in graphical 
and tabular form. All the models displayed some degree of difficulty in 
tracking particular types or portions of anomalous reliability growth 
patterns. The cumulative model displayed this difficulty the least and 
exhibited good variability (precision) performance providing confidence 
in its use. The instantaneous model, while displaying generally good ac- 
curacy, exhibited poor variability performance. Except for a couple of 
anomalous situations, the discrete model showed good accuracy and vari- 
ability performance. Forecasting performance of all the models proved 
to be worse than their capability 2 determine current reliability 


ratus. 
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|. INTRODUCTION 


New weapons systems components characteristically display very low 
initial reliability as they begin progress through early development and 
testing. This low infant reliability of a system and its components is 
common to many commercial systems such as automobiles, aircraft, etc. 
as well as complex military systems. The reticence of contractors to 
divulge early test data that reveals this low infant reliability can 
handicap the project officer and contractor in exercising their manage- 
rial responsibility to bring the system in on time at the specified re- 
liability level. Because reliability growth is not tracked in early 
development stages, timely opportunities to either accelerate or inten- 
sify development by reallocating funds during the initial design/devel- 
opment phases of a system acquisition cycle are frequently lost.  Conse- 
quently, managers can lose an opportunity to support their projects at 
a time of greatest need. 

There exists anabundance of reliability growth models designed to 
assist managers in charting the reliability status of a system and its 
components during any stage of development and testing. Unfortunately, 
the benefits, accuracies, and comparisons of these models are not always 
understood by management staff who could profit from their use. 

The primary purpose of this thesis was to evaluate three easily 
understood, relatively simple reliability growth models which would 
hopefully prove to be reasonably accurate over a broad spectrum of 
reliability growth situations. Conditioned upon this demonstrated 


versatility in a wide variety of circumstances, the ultimate goal is 





for employment and utilization of these reliability growth models by 
management on a significantly larger scale with increased willingness 
to share reliability progress information between contractor and custom- 
er. The evaluation was intentionally not structured to ascertain the 
capabilities of the reliability growth models as high resolution tools 
in very restricted situations but rather as gross models for flagging 
significant deviations of a system's or component's reliability progress 
from a desired or expected reliability growth pattern. Hence, the 
models' ability to alert managers that consideration of corrective action 
or at least more intense scrutiny of reliability status is required was 
established as a goal of the evaluation. Perhaps the greatest potential 
windfall benefit of utilizing capable reliability growth models as a 
project management tool is a reduction in cost overruns that have plagued 
weapons systems development since the 1950's. A primary cause of weapons 
systems cost overruns as noted in reference 3 is trying to develop and 
produce the systems too fast. 

Since the underlying reliability progress pattern of a new system 
and its components is unknown to the project officer and contractor, 
these managers essentially need a ''model for all seasons'. In this vein 
the attributes desired in a reliability growth model are accuracy and 
robustness. Hence, a model(s) that can discern the true underlying re- 
liability progress pattern with some degree of fidelity (accuracy) with- 
Out sacrificing the capacity to cope with a significantly diverse range 
of reliability progress patterns (robustness) is the tool managers seek. 

With these attributes in mind a continuous cumulative failure rate 
reliability growth model, a continuous instantaneous failure rate reli- 


ability growth model, and a discrete reliability growth model were chosen 
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for evaluation. Since each model is structured to measure a different 
parametric indicator of reliability progress, no direct comparisons 
between the models' performance were made. The models are presumptuous 
as the generally accepted title reliability growth models implies. In 
order to evaluate the models' accuracy and robustness not only were they 
tested against 'nice' underlying reliability progress paths, but also, 
they were confronted with underlying patterns which exhibited relia- 
bility stagnation and degradation prior to continued growth as well as 
patterns demonstrating no reliability progress. 

The three reliability growth models evaluated in this thesis are 
designed to be very general in the nature of the items for which they 
propose to chart reliability progress. The models can be employed for 
reliability tracking at the system level, sub-system level, and/or the 
individual component level during any phase of an acquisition cycle to 
include even retrofit programs. Hence, for the balance of this thesis 
"component'' and 'item' are used to reference an entire system, or a 
sub-system, or an acy dual component for which reliability progress 
is being modelled as appropriate. 

The evaluation technique utilized computer simulation which permits 
the underlying reliability progress patterns to be specified while 
observing the models' performance in both determining and forecasting 
the underlying progress patterns. The simulation technique and evalua- 


tion measures are described in the next chapter. 
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A. EVALUATION METHOD 

Performance evaluation of both continuous failure rate reliability 
growth models and the discrete reliability growth model was Е са 
using computer Monte Carlo simulation. Computer simulation permits the 
analyst to specify and control the underlying reliability path of growth. 
By utilizing simulation data that is equivalent to data normally avail- 
able in a testing and development program the models' performance may 
be compared with the specified underlying reliability path. 

The continuous cumulative failure rate reliability growth model and 
the continuous instantaneous failure rate reliability growth model both 
utilize the same data from a testing and development program. Therefore, 
these two models were evaluated simultaneously in a unified simulation 
program. The test program assumed for the continuous models is essen- 
tially a deterministic program in which testing of items in any given 
test phase can be accomplished simultaneously since the number of items 
to be tested within each phase is specified prior co conduct of the 
test phase. On the other hand the discrete reliability growth model is 
based on a sequential test structure in which the number of units tested 
cannot be specified beforehand; specifically, testing in each e 15 
continued until a specified number of failures are observed which in 
turn generate a significant development or production change that hope- 
fully improves reliability. Consequently, the number of tests within a 


test phase are random. Because of this dissimilarity in test program 





structure for the continuous and discrete models, a separate simulation 


program was run for evaluation of the discrete reliability growth model. 


EEEEMEASURES OF EFFECTIVENESS 

As indicated in the introduction, the primary goal of this evaluation 
was to demonstrate the capability of selected reliability growth models 
to estimate unknown, underlying reliability progress paths with suffi- 
cient accuracy and versatility. Thus, the capability of the models to 
satisfy these requirements is a question of their accuracy and precision; 
i.e., (1) how close do the models' reliability or failure rate estimates 
approximate the true underlying reliability or failure rate paths and 
(2) are the models consistent in their approximations? 

To answer these two questions regarding the models' capabilities the 
simulations were replicated one-hundred times for each underlying reli- 
ability progress path specified. The number of replications was actual- 
ly programmed as a 'user specified'" input variable and could have been 
chosen to be ten runs for one progress path and a thousand runs for 
another progress path.  One-hundred replications for all progress paths 
was chosen as a sufficiently large number to provide confidence in the 
test results while holding computer processing time requirements within 
acceptable limits. Two simple statistics were then computed for each 
model's performance on each specified underlying reliability progress 
path. 

First, the average values (arithmetic means) of the models' estimates 
of the parameter utilized in the characterization of the underlying re- 
liability progress path were computed to provide a measure of the models' 


accuracy. Average values of reliability or failure rate estimates were 








computed for both the current reliability status at the end of a test 
phase and the forecast reliability status at the end of the following 
test phase. While a summary of these parameter mean value results could 
be presented in tabular form, such mode of presentation is difficult and 
time consuming to comprehend. Therefore, a graphical presentation was 
selected over the tabular form. The grapnical presentation permits 

easy qualitative evaluation of a model's accuracy and recognition of 
estimate trends such as consistent optimistic/pessimistic estimation of 
the reliability progress path. 

For each particular reliability growth model, test structure, and 
specified underlying reliability progress path, a graph was prepared 
depicting the true underlying path, the model's mean estimated value for 
the reliability or failure rate at the end of each test phase, and the 
model's mean forecast reliability or failure rate for the end of the 
following test phase. Since a total of 198 different combinations were 
Simulated, graphs for all the simulation results are not presented. In 
those cases where no significant change in accuracy or trend results 
occurs graphs are omitted. 

Project managers are concerned with only one ''replication'' of the 
reliability progress path estimation task as opposed to ten, one-hundred, 
ог a thousand progress path estimates. Given that the mean performance 
of a reliability growth model is satisfactory, managers need to know if 
the model can be trusted to deliver satisfactory performance on that 
single ''replication''. This concern equates to the question of varia- 
bility (precision) in the model estimates; i.e., does the model deliver 
"tight groups' around the mean values of its estimates? To measure 


variability the standard deviation of each model's reliability or failure 





rate estimates from the mean value performance was computed for all 
Дэв of all simulations. 

Since standard deviation is a relative measure, it is difficult to 
recognize trend in the performance of the reliability growth models from 
a table of standard deviation statistics. So, variability performance 
of the reliability growth models is presented in tabular form containing 
entries of standard deviation of the model estimates expressed as per- 

. centages of the magnitude of the reliability or failure rate values to 
which they correspond. (This statistic is the coefficient of variation 
expressed as a percentage; i.e., the percentage standard error.) Because 
gross performance characteristics of the reliability growth models were 
being evaluated, all percentages were truncated to the whole percentage 
point to facilitate examination of the variability performance tables 

for trends. 

In examining the variability performance of the reliability growth 
models some guideline is desirable. In the field of econometric models 
a percentage standard error of 10-15% is the goal given by reference 6. 
In cost estimation modelling a percentage standard error of 15-20% is 
considered satisfactory according to reference 8. A reliability growth 
model that exhibits good mean estimation performance but displays very 
poor variability performance may be useless for practical purposes. On 
the other hand a reliability growth model that produces excellent vari- 
ability performance coupled with poor but consistently biased mean esti- 
mation performance may prove to be very useful. Ultimately, the project 
manager will have to decide if the performance characteristics displayed 
by the reliability growth models examined in the next chapter qualify 


these models for application to his project. 





Ill. RELIABILITY GROWTH MODEL DESCRIPTIONS 
AND PERFORMANCE RESULTS 


A. CONTINUOUS CUMULATIVE FAILURE RATE RELIABILITY GROWTH MODEL 
1, Model posco 
The continuous cumulative failure rate model evaluated is of 


the form 


where 
λττ = cumulative failure rate of the item thru time TT, 
TT = total accumulated test time for all testing, and 


a,8 = constants that determine the shape of the model 
estimated reliability progress path. 


Cumulative failure rate may also be thought of as average failure rate 
or characteristic failure rate. Under the assumption that а is posi- 
tive, the model relationship is that as test time is accumulated on an 
item (and by implication discrepancies discovered in the item are cor- 
rected) the denominator of the right-hand side of equation 3.1 increases; 
and hence, the cumulative failure rate of the item decreases. So reli- 
ability growth is modelled as decreasing failure rate by this model. 
Total accumulated test time TT is measured in whatever units are appro- 
priate to the item being tested; i.e., minutes, hours, days, years, etc. 
Or mission units. The model is considered continuous since the single 


independent variable TT , total accumulated test time, is continuous 





as opposed to a discrete variable such as the number of failures experi- 
enced or the number of item modifications accomplished. 

If the failure rate being experienced during any particular 
phase of testing is thought of as the instantaneous failure rate, then 
within the context of reliability growth instantaneous failure rate is 
expected to decrease as testing proceeds from phase to phase just as 
cumulative failure rate is expected to decrease. Since cumulative fail- 
ure rate is a characterization of the failure rate of the item based on 
all the testing that has been accomplished; i.e., an ''average'' measure 
of failure rate, then cumulative failure rate is expected to be greater 
than the instantaneous failure rate at any point after the initial test 
phase when the two measures are equal. Conversely, if the reliability 
of the item decreases as the acquisition cycle develops (increasing in- 
Stantaneous and cumulative failure rate), then cumulative failure rate 
is expected to be less than the instantaneous failure rate being experi- 
enced at any phase after the initial phase of testing. 

A mathematical analysis of the cumulative failure rate model is 
given in reference 2. 

2. Reliability Testing Procedure 

For the continuous failure rate reliability growth models the 
appropriate reliability testing procedure of a system acquisition model 
is one that is conducted in distinct test phases. These test phases are 
indexed by i with a total of K phases comprising the duration of the pro- 
6; i.e., i = 1, 2, 3, ... , K. [wi thin each phase of a testing a 
specified number of tests are conducted where the number of tests is 
denoted by wr, | me number of tests per phase NT. can vary from 


phase to phase. During each phase of testing an underlying, inherent 





failure rate that is unknown to the project managers/contractors is pres- 
ent in the item under test. This underlying failure rate is the instan- 
taneous failure rate of the item for each phase and is denoted as À. 
Also, during each phase of testing a phase total test time is accumulated 
and labeled as T. . Hence, at the completion of test phase i the total 


accumulated test time TT. on the item is given by 


TT, = > т, 207 
ΤΕ 


E -1,2, 3, ..., K and TT, = Ti 

For each phase of the testing program a planned test time is es- 
tablished beforehand after which items under test that are still func- 
tioning are judged successful; i.e., non-failures. The planned test 
time for test phase i is denoted as РТТ, . Therefore, the maximum test 
time that can be accumulated during any given test phase i is given by 
the product NT. x РТТ, and occurs only when none of the NT. components 
tested fail. During each phase of the testing the number of failures 
that does occur is recorded as нэ [At the end of test phase i the total 


number of failures experienced for the entire testing procedure thru 


phase i is given by 


IF -2, F, (3.3) 


ELS !,2, 3, ..., K and ТЕ, - E 
Figure 3.1 is a schematic diagram of the continuous models reli- 


ability testing procedure. The total number of test phases K, the number 


of tests conducted during each test phase NT., and the planned test time 
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UT. at which an item under test is considered successful are determined 
prior to testing. Тһе test time T. accumulated during each test phase, 


E u Ee | 


the total accumulated test time TT. at the end of each test phase, the 


Ха 


number of failures Е mS dm each test phase, and м 
number of failures TF. accumulate for the entire testing procedure thru 
the end of each test phase are all data collected from the reliability 
testing procedure. The most salient feature of the computer simulation 
of this reliability testing procedure is that the analyst also specifies 
the underlying instantaneous failure rate Х, that is effective for each 
phase, Thus an accurate assessment of the accuracy of the model can be 
made because the Х, values are known. 
3. Reliability Testing Procedure Computer Simulation 
a. Summary 

The reliability test procedure appropriate to the continuous 
failure rate reliability growth models was simulated on the Naval Post- 
graduate School W. R. Church Computer Center's ΙΒΜ 360/67 System utiliz- 
ing standard computer simulation techniques. Reliability testing proce- 
dure design parameters K, NT., and РТТ, were specified along with 
various underlying instantaneous failure rate sets. Tests of components 
were then simulated with component success or failure being determined 
for each test based on the appropriate underlying instantaneous failure 
rate А. and the planned test time РТТ, А T. Τι, Fi and TF; test 
data were collected as each testing procedure simulation was accomplished. 
Simulations of reliability testing procedures for each specified instan- 
taneous failure rate set were replicated one-hundred times in order to 
assess the continuous failure rate reliability growth models' variability 


performance. 
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After the reliability testing procedure simulations were com- 
pleted, continuous failure rate reliability growth model estimates of the 
underlying cumulative and instantaneous failure rate of the component 
being tested were produced based on the simulation test data by computa- 
tions utilizing ordinary least squares regression techniques. Simple 
mean and variability statistics of these model estimates were then computed 
to permit performance evaluation of the continuous failure rate models. 

b. Detail Description 

The computer simulation of the continuous cumulative and the 
continuous instantaneous failure rate reliability growth models was ini- 
tiated by reading in the following reliability testing procedure design 
specifications: K, the total number of test phases; ντι, the number of 
tests to be conducted during each test phase; Ху, the underlying instan- 
taneous failure rate effective during each test phase; and NSIMS, the 
number of times the specified reliability testing procedure was to be 
simulated. For this thesis NSIMS was always specified as one-hundred 
simulations. 

Rather than specify the test phase planned test times РТТ, 
at which components still operating were considered not to have failed 
for each phase, planned test times were calculated for each test phase 


Such that 


exp A. X PTT.) ο το 


РТТ, = - πο}. (3 9) 


i 
The lifetimes of components tested during each test phase i were taken 


to be exponentially distributed with mean time to failure (MTTF) МА, 


2 | 





The planned test times given by equation 3.4 result in each component 
tested having a 70% chance of surviving the test phase. This figure for 
survival probability of 0.7 was chosen arbitrarily to insure that some 
component failures were generated. 

The procedure for specifying planned test times РТТ, admi t- 
tedly deviates from actual test procedure design since the calculation 
in equation 3.4 is dependent upon the underlying instantaneous failure 
rate which is unknown in real life testing. However, if a reliability 
testing procedure is being conducted under the assumption of reliability 
growth, planned test times РТТ, would naturally be specified as increas- 
ing from test phase to test phase as the expected failure rate decreases. 
If the true underlying failure rate should stagnate or worsen from one 
test phase to the next, then the probability that components fail during 
the next test phase increases since planned test time will have been 
lengthened. Consequently, more failures would generally result than if 
the underlying reliability progress path had followed the expected ''nice'' 
growth pattern; i.e., decreasing failure rate. 

After specification data were read into the computer, uniform 
(0,1) random variates were drawn; one corresponding to each component 
tested in each of the K total test phases; i.e., uniform random variates 
were drawn and indexed as P Дон 2-1 2222020222 2 41400 1-1-2-3, 

Е ντι. For this evaluation the life length of components was assumed 

to be exponentially distributed. The assumption is a strong one, and the 
performance characteristics of the models under other than the exponen- 
tial lifetime distribution assumption might prove to be a fruitful area 


for evaluation. Next, the uniform random variates were transformed into 


exponential lifetimes for the components under test via the probability 
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integral transform as given in reference 4; i.e., each component was as- 


signed a test lifetime Е. j according to 


? 


η παν»... 2. 5, ... , Кап4 j » 1,2, 3, ... , NT.. 
The number of failures = that occurred during each test 
phase was then tallied by comparing the test lifetime E. j of each com- 


2 


ponent with the appropriate planned test time РТТ, such that 


NT. Ip EE РТТ, (Failure) 


| | , 


B. -2, ὃ, where ê. = (3.6) 


if E. j > РТТ, (Success) 


М 


moni = |, 2, 3, ... , K. Similarly, the test time T. accumulated for 


each test phase was recorded as 


NT. COME “ЇЇ PIL 
! EP s) | 
T; =D ям where ий - | (277) 
jl ιτ. 
| TM | 
ШІ | - |І, 2 3, ... , К. Finally, the corresponding total failures ТЕ. 


апа total test times ТТ, accumulated thru the end of each test phase 


were tallied as 


F , and (3.8)‏ > ا 
al‏ 
Ї‏ 
E »» Т, (3.9)‏ 
181 
magi = |, 2, 3, .-. , K respectively.‏ 
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In keeping with accepted reliability growth modelling prac- 
tice for reliability testing procedures utilizing planned test times, 
in those cases where no failures were experienced during a given test 
phase (Р. = 0) the number of failures for that test was assigned as one- 
half a failure; ie., F. ==. Similarly, whenever the total failures 
accumulated thru a given test phase were zero (КЕ - 0) based on the 
original failures per test phase statistics (TF, = 2 Р. = 0), then 


Е Ј 
j=l 
total failures accumulated thru that phase were assigned as one-half a 


ШІ 
2 


that zero failure statistics result in failure rate estimates of 0.0 


failure; i.e., TF. = The primary thrust of these modifications is 
which are extremely unrealistic and would virtually never occur under 

the exponential lifetime distribution assumption if infinite planned test 
times were possible. Hence, the one-half failure assignment procedure 
results in optimistic but positive failure rate estimates for those in- 
stances in which no failures are experienced. 

These data constituted the total data gathered from a single 
computer simulation of the continuous model reliability testing proce- 
dure for a single specified underlying reliability progress path; i.e., 

a specified set of failure rates which shall henceforth be referred to 
as a lambda set. This computer simulation was repeated one-hundred times 
(NSIMS = 100) for each specified lambda set where the simulation repli- 
cation is indexed as r = |, 2, 3, NE NSIMS = 100. Therefore, all the 
simulation data are indexed by the simulation number r which has been 
left implicit for simplification; i.e., the simulation results are F. _, 


p 


TF; гэ Т. г> апа ТТ. E Since twenty-eight different lambda sets were 
utilized for evaluating the continuous failure rate reliability growth 


models with three different number of tests per test phase NT. Specified 
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for each lambda set, 8400 reliability testing procedures were simulated 
for the continuous reliability growth models evaluation. 
h. Computer Simulation Data Manipulation 

The continuous cumulative failure rate reliability growth model 
is proposed as a model of the unknown, underlying cumulative failure 
rate λττ of a component as it proceeds thru a system acquisition cycle. 
In each reliability testing procedure computer simulation the true cumu- 
lative failure rate λττ that was in effect at the end of a test phase 
was determined by the test time weighted average of the underlying true 


instantaneous failure rates А. that were in effect thru the end of the 


given test phase. Thus, the true cumulative failure rate was determined 


as 
| Т, 
Ая ХА. тт 15510 
TT; 2 1 ТТ. 
ул! 
ИЕ | 2,3, ... , К. It is against this true cumulative failure 


rate that the model's performance was measured. 
At the end of a phase of testing an estimator of the instanta- 


neous failure rate for that phase of testing is given by 


Number of Failures Experienced During Phase i F. 
E ` Test Time Accumulated During Phase i ü Um (3.11) 
E - 1.2.53, ... , K. In turn an estimator of the cumulative fail- 


ure rate thru the end of a phase of testing is given by the test time 


weighted average of the instantaneous failure rate estimates; i.e., 


лм a AN / 
TT, 22 i TT: . (3.12) 
14 
for t = 1, 2, 3, ... , K. Note that since TT, = ШЕ then Ay. = 


да 





The estimator of the cumulative failure rate thru the end of any test 


phase may also be stated as 


E a 
TT. i от. 
Σ, T. 
J 
у=! 
ШІ! з 1, 2, 3, ... , K by the following line of reason: τ 
by equation 3.11; and therefore, 
i i 
pa an : 
ЇЕ, = F. = ОО Т, by equation 3.8. 
NE 1271! vmm 
у= j=] 
50, | 
E T. 
TF | s | Т 
ще NS - 
ІІ ТТ, FI j ТИ 
i i ΓΞ i 
Em -1,2,3, Mich is equivalent to equation 3.12 
TF, = š and τ Ξ T. , then 
ου τος 
TT, ТТ, Т, 1 T | 1 Ti 1 


The estimates of the instantaneous failure rate x 


(3.13) 


(3.14) 


Since 


2221) 


and the 


: : oN eto 
cumulative failure rate ATT are based on data from a reliability 


testing procedure utilizing planned test times РТТ, . Therefore, the 


estimates obtained from equations 3.11 and 3.13 are biased estimates, 


the bias being in the pessimistic direction. In particular all of the 
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instantaneous failure rate estimates and the cumulative failure rate 
estimates for the early phases of the testing procedure are biased too 
large in magnitude. To compensate for this estimator bias a bias correc- 
tion factor derived in reference 7 was applied to the instantaneous fail- 


ure rate estimates ev and the cumulative failure rate estimates À 


Un 
such that 
N one (3.16) 
i A i 
л 
2 МТ, 
! 2; МЕ 
^T Ше n 
MT. ü DV | c (3.17) 
] + 2 NT. 
| E 
) Ч 
mee 1, 2, 3, .-. , K. 


Next, estimates of a and В in the cumulative failure rate 
model, equation 3.1, were obtained using ordinary least squares regres- 
sion techniques. Because ordinary least squares regression requires at 
least two observation points, estimates for a and 8 could only be 
derived from the model starting at the conclusion of phase two; i.e., 
estimates were derived for phases |І = 2, 3, 4, ... , K. 

If the cumulative failure rate model in equation 3.1 is written 
as 


m 


E UE | (3.18) 
i 


and the logarithmic transformation is applied to this equation, then 


ln À = 8, τα. In TT, š (3.19) 
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Letting 4 te = а^ 


| 
= 1 
X =+ 2, X, , and 


Set 
i 
E Y. , 
J 
j. 
then equation 3.19 is of the form 
Y. = а, + b. Х, 1 220) 
4 í : 
Note that the estimated cumulative failure rates А from equation 


ТТ. 


3.17 are utilized in performing the regressions. Applying ordinary 
least squares regression estimates as given in reference 6 the a and 


л : 
b. estimates are 


j 
“Б, > 0 and 22221) 
ma 
то. 
Y 0» 
je 
= = Y ш (2722) 
miei = 2, 3, 4, ... , K. The T and estimates are then obtained 
by the inverse transformations © = <b. and A = exp (733 ). Finally, 





Ben . э ар : : 
these a. and %; estimates are utilized in the cumulative failure 


———— — oor RP 


rate model, equation 3.18, to produce the model estimates of the unknown, 


تھ ڪڪ 


underlying cumulative failure rate. These estimates are given by 


^ yo 
| “ν Ez | 
| as 
TT. 
for i = 2, 3, 4, ... , K. For the first test phase the cumulative fail- 


ure rate estimate is simply taken as the estimate given by equation 3.17; 


i.e., 
— F 2 NT 
MT, > p == + 201) E 
| | وغ‎ N ] t 


Again, since the reliability testing procedure was simulated one- 
hundred times (NSIMS - 100) for each lambda set, one-hundred estimates 
of the cumulative failure rate were obtained for each test phase. The 


mean value and standard deviation of these estimates were computed as 






> NS IMS 
х _ ] * 
πη NS IMS E Mr ) dne (3.25) 
=] , 
NSIMS то 
N, е. 
oN ] 2 ES D 
e — —— n се. = 
TE шт}; (ОХ ЗА) (3.26) 
ΤΙ. Ї uis | 
| r=] 
Ix |, 2, 3, ... , K.- Finally, the measure of variability for the 
cumulative failure rate model was computed as 
ша 
л ТТ, 
Р.5.Е..% -------х 100 (27) 
TT. 2 
Ta 
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| 


ЯЛ - |, 2, 3, ... , К. 
Because the phase total test time T; and the total accumulated 
test time TT. are random variables which changed from simulation to 


simulation, their mean values were computed as 








NS IMS 
= | 
E µε Mer лс (3.28) 
r=] 
NSIMS 
== ] 
Drac 23 n: (3.23) 
r=] 


respectively for i = 1, 2, 3, ., K. Similarly, the mean value of the 
true underlying test time weighted average cumulative failure rate was 


computed as 





NS IMS 

TE 

TT. ~ NSIMS 3 (3.30) 
r=] : 


Жэ - 1, 2, 3, ... , K.. Figure 3.2 is a graphical representation of 
the results obtained from the reliability testing procedure for the con- 
tinuous cumulative failure rate reliability growth model. 
A B 
Equations 3.25 ( AL. ) апа 3.7 (Р.5$.Е.,*` ) are measures of the 
ΤΙ. λ 
| ТТ. 

cumulative failure rate reliability growth model's performance in deter- 
mining what a component's reliability status is at the end of a test 
phase. To examine the cumulative model's forecasting capability the 
following procedure was followed. The total accumulated test time ТТ. 
of the cumulative model, equation 3.18 , is a stochastic (random) vari- 


able. Hence, at the end of any test phase i the total accumulated test 


time for subsequent phases of testing \ТТ. в TT. 12» ...) is unknown but 
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required if the model is to be used for forecasting. For this evalua- 
tion'a one test phase in the future forecast of cumulative failure rate 
was made by approximating the next test phase (i+l) total accumulated 


test time from the current test phase as 


N 


Т5 = ТТ. + (МТ. X PTT. р) (3.31) 


1 = 


for i = 2, 3, 4, ...,K. Thus at the end of a given test phase i the 

recorded total accumulated test time TT. for that phase was added to 
the maximum phase total test time that could be accumulated during the 
following test phase itl; i.e., the number of items to be tested ΝΤ 


times the planned test time РТТ. for the next test phase. This pro- 


cedure thus approximated the most optimistic outcome; i.e., no failures 
for the following test phase 1+1. The approximated total accumulated 
. test time Tey for the next phase was then utilized in the current 


phase i cumulative model to obtain a next phase forecast cumulative 


failure rate as 


©; 
Phat 221817) | (3.32) 
НО -2 3, 4, ... , K. Therefore, forecast cumulative failure rates 
were made for test phases i = 3, В, 5, ‚ К. No forecast could be 


made for test phase 2 because the model parameters oF and 8. were not 
estimated until test phase 2 was completed. Мо forecast was made past 
test phase K since there would be no underlying cumulative failure rate 
with which to compare. Finally, forecast cumulative failure rate sta- 
tistics similar to the determined failure rate statistics in equations 
3.25, 3.26, and 3.27 were computed for the simulation replications 


(NSIMS = 100) as 


ο 





— ] = 
Í  NSIMS > P. - (3.33) 
=! 2 
NSIMS Κον 
| 2 ZN 2 
ЕМ = OE NEN σολ. E 
К; кети т 2, (Pu. сг 5 zu 3.34) 
ΠΤ. Ir i 
| rz] 
SID > 
FATT. 
E - — - x 100 (3.35) 
EB я 
Ши 
Е З, 4, 5, y K 


As a starting point for the evaluation of the continuous failure 
rate models the lambda sets utilized by Jayachandran and Moore in refer- 
ence 5 were adopted as specified underlying instantaneous failure rate 
Х, sets for five reliability progress paths. These lambda sets are 
listed in table 3.1 where they are numbered as lambda sets 1 thru 5. 
Lambda sets 1 thru 5 represent 'nice'" reliability progress paths since, 
although they vary in rate and span of failure rate decay, they have 
smooth exponential like decay patterns (curves). A decaying failure rate 
path is equivalent to a reliability progress path that displays growth. 

Note in table 3.1 that for lambda set 3 for example the specified 
underlying instantaneous failure rate starts at 0.700 for test phase |, 
decreases to 0.3530 during test phase 2, and finally reaches a value of 
0.0500 for the last test phase, test phase 16. 

Because a primary goal of this thesis was to evaluate the robust- 
ness of the selected reliability growth models, the “пісе! lambda sets | 
thru 5 were augmented with nine anomalous lambda sets numbered 6 thru 15 


which are also listed in table 3.1. Lambda sets 6 and 7 represent 
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approximately linear underlying reliability progress paths. Lambda sets 
8, 9, and 10 portray underlying reliability progress paths in which 
reliability rapidly attains a certain level and stagnates at that level 
for the duration of the reliability testing procedure (acquisition cycle). 
Lambda sets 1] and 12 display initial 'nice' reliability growth followed 
by a period of reliability stagnation and a subsequent continued growth 
pattern. Finally, lambda sets 13 and 14 represent underlying reliability 
progress paths in which reliability growth is interrupted by a period of 
reliability degradation. 

As indicated in table 3.1 lambda sets 1 thru 14 each represents 
reliability testing procedures of systems acquisition cycles consisting 
of sixteen test phases (K = 16). For very expensive and complex weapons 
systems a sixteen test phase procedure may not be feasible. Therefore, 
lambda sets for a more realistic six test phase (K = 6) cycle were also 
utilized in the computer simulation evaluation. These lambda sets for a 
contracted reliability testing procedure are listed in table 3.2 and 
numbered MOD] thru MODI4. Lambda sets MOD] thru MOD14 represent underly- 
ing reliability progress patterns that are equivalent to the progress 
patterns characterized by lambda sets 1 thru 14 but which develop during 
a Six test phase cycle rather than over a sixteen test phase cycle. 

In order to examine the continuous failure rate reliability 
growth models for a representative set of acquisition programs, procedures 
with items tested per test phase NT; of five, ten, and twenty items were 
simulated utilizing all twenty-eight lambda sets; i.e., NT. = 5, 10, and 
Or |І = |, 2, 3, ... , l6 or i = 1, 2, 3, 4, 5, 6 as appropriate. 
Hence, 28 x 3 x 100 = 8400 reliability testing procedures were simulated 


for the continuous failure rate reliability growth models evaluation. 
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5. Model Performance 
a. Accuracy Performance 
Figures 3.3 thru 3.41 present selected cases of the continu- 
ous failure rate reliability growth model's capability to determine and 
forecast the unknown, underlying cumulative failure rate progress path 


during an acquisition cycle. These graphs depict the mean test time 


weighted average true underlying cumulative failure rate E progress 
Ї 
path from equation 3.30 (—— , solid line), the mean model determined 


> 


cumulative fallure rate TT for each test phase from equation 3.25 (6, 
Ї 


š . ZN 
circles), and the mean model forecast cumulative failure rate Fir for 


| 
the third thru the final test phase from equation 3.33 (X , crosses) 


plotted versus the mean total accumulated test time ТТ. from equation 
3.29. Note that the point plotted for the test phase | mean model deter- 
mined cumulative failure rate is not a mean model determined estimate; 
but rather, it is the mean estimate of the cumulative failure rate (and 


instantaneous failure rate since the estimate is for test phase 1) given 


AN 


by equation 3.24 ( Aw - Ху). So the accuracy of the reliability esti- 
1 


mator of equation 3.24 may also be observed to a degree by examining the 
results for test phase |1. 

To illustrate these quantities graphed in the accuracy perfor- 
mance figures note on figure 3.11 that at approximately 82.00 total accu- 


mulated test time units the mean weighted cumulative failure rate p 


A 16 
ша 


was approximately 0.45 and the mean model forecast cumulative failure 


> 
rate Γλττ was approximately 0.50. Since these values were the last 


was 0.30 while the mean model determined cumulative failure rate 


points on the plot, they represent the simulation results for the six- 


teenth phase of a reliability testing procedure wherein five tests per 
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phase were conducted and for which lambda set 7 from table 3.1 specified 
the unknown, underlying reliability progress path. Also, note that the 
first mean model forecast cumulative failure rate point corresponds to 
the third mean model determined cumulative failure rate plotted; i.e., 
the first model forecast cumulative failure rate was for test phase 3 
(i = 3). Finally, for test phase 1 the point plotted for the mean model 
determined cumulative failure rate is approximately 0.73 which is actual- 
ly the mean value of the estimate produced by the instantaneous failure 
rate estimator of equation 3.24. Notice that the mean test time weighted 
average cumulative failure rate at test phase | is 0.70 which corresponds 
to the specified underlying instantaneous failure rate for this phase 
from table 3.1. This equivalence is explained by equation 3.15. 

aures bus. 9 and $3.25 thru 3.29 indicate that for 
"nice' underlying reliability progress paths the cumulative failure rate 
model displays very accurate performance with slight pessimistic bias 
(higher failure rate estimates). "Least data” graphs; i.e., five tests 
per phase cases (NT, - 5) are generally displayed. Ten and twenty tests 
per phase (NT, = 10/20) performance was as good as or better than five 
tests per phase for all cases in which only the NT. = 5 graphs are 
Shown. This consistency of performance is displayed for lambda set 3, 
NT. - 5/10/20 sequence in figures 3.5, 3.6, and 3.7. Forecasting perfor- 
mance displays a general trend of overly pessimistic forecasts for the 
first two or three phases improving rapidly after four or five forecasts 
have been made. 

Figures 3.10 thru 3.13, 3.30, and 3.31 reveal Л the cumu- 


lative failure rate model has some difficulty in tracking linear under- 


lying reliability growth patterns even when a relatively large amount 
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ENS are available (figure 3.13, NT, = 20). In all the linear cases 
both the model determined and model forecast mean failure rates diverge 
from the actual cumulative failure rate. Performance does not improve 
as the number of components tested per phase is increased as evidenced 
by the lambda set 7, NT: = 5/10/20 sequence performance in figures 3.11, 
КОШ апа 3.13. 

Figures 3.14 thru 3.20 and 3.32 thru 3.36 indicate that the 
cumulative failure rate model copes with permanently Stagnated underly- 
ing reliability progress paths easily. The figure series 3.14 thru 3.16, 
3.18 thru 3.20, and 3.32 thru 3.34 contrast the accuracy performance for 
increaSing number of test per phase (NT, = 5/10/20). Again, forecasting 
performance is initially very poor but quickly improves after three of 
four forecasts have been made. 

In situations of the underlying reliability progress path 
experiencing temporary stagnation figures 3.21, 3.22, and 3.37 thru 3.39 
reveal that the cumulative failure rate model, while picking up the 
stagnation credibly, has difficulty in accurately modelling the cumula- 
tive reliability improvement following the period of temporary stagna- 
tion. During this post stagnation improvement phase, the cumulative 
model's determined and forecast failure rate estimates diverge on the 
pessimistic side from the true underlying cumulative failure rate path 
much as they did in the linear underlying progress path cases. Figures 
3.38 and 3.39 show that this trait is not relieved by gathering more 
test data per test phase of the reliability testing procedure (ΝΤ. = 5 


VS ; NT. = 20 


39 


G ы 





MERN CUMULRTIVE FRILURE RRTE 


0.30 


. 00 


. 1 MERN WEIGHTED CUMULATIVE FRILURE RRTE 


c 

T O + MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
= x 1 MERN MODEL FORECRST CUMULATIVE FRILURE RATE 
eo | 

e 

O 

o |9 

pa 


0. 


0.50 0.60 


0.u0 


0.20 








O 

O 

“0.00 25.00 50.00 75.00 100.00 125.00 150.00 175.00 
TOTAL ACCUMULATED TEST TIME 


paa Ung. 3:2 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
Мо 027722 лев PHASES, 5 TESTS/PHASE 


40 





MERN CUMULRTIVE FAILURE RATE 
10 0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 . 00 


0. 


p.00 


- 1 MEAN WEIGHTED CUMULATIVE FAILURE RATE 
O :« MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x + MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 





9.00 


ч 54.00 63.00 


18.00 27.00 36.00 . 00 
ο ο  σΟ ΙΟ РЕ ОТЕ ЭТ TIME 


FIGURE 3.4 


πα ο ΟΕ ΠΕΙ ΙΕΡΗ 11 GROWTH MOOEL PERFORMANCE 
ШЕШЕ ШИЕ ЕИО: 16 PHASES, 5 TESTS/RHASL 


A] 





MEAN CUMULATIVE FAILURE RATE 


0.30 


1.00 


Ë _ t MEPN WEIGHTED CUMULATIVE FAILURE RATE 

T (9 +: MEAN MODEL DETERMINED CUMULATIVE FAILURE PATE 
= x 1 MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
e 

© 

о 

e 

pa 

o 


0.50 0.60 


0.40 


0.20 


0. 





© 

94 

9.00 40.00 80.00 120.00 160.00 20000 240.00 280.00 
TOTAL ACCUMULATED TEST TIME 


ο τς eso 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
CEB SET GS: 15 PHASES, 5 TESTS/PHASE 


42 








MERN CUMULRTIVE FRILURE RRTE 


0.30 


1.00 





. t MERN WEIGHTED CUMULATIVE FAILURE RATE 
O τι MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x : MERN MODEL FORECAST CUMULATIVE FRILURE RATE 


0.50 0.60 0.70 0.80 0.90 


0.40 


0.20 


0.10 


e 

O 

9) 00 80.00 160.00 240 320.00 4009.00 480.00 560.00 
TOTAL ACCUMULATED TEST TIME 


FIGURE 3.6 


2 ца сэн  Тг 00 0 79 MOREL PERFORMANCE 
ΕΗ ΕΤ: 16 PHASES, 10 TESTS/PHRSE 


53 





MERN CUMULRTIVE FRILURE RRTE 


. 00 


1 


© . 1 MEAN WEIGHTED CUMULATIVE FAILURE RATE 

= O : MERN MODEL DETERMINED CUMULATIVE FAILURE RATE 
= x : MERN MODEL FORECRST CUMULATIVE FRILURE RATE 
со 

92 

© 

сә 

m 

o 


0. 30 0.40 0.50 0.60 
X 


0.20 





. 10 






p.00 





46.50 62.00 


15.50 31.00 77.50 33.00 108.50 
ШИ. 52:21 2 2 1 TEST TIME U 


FIGURE 3./ 


CUMULRTIVE RELIRBILITY GROHTH MODEL PERFORMRNCE 
BOR SEI I: 16 FHASES, 20 TESTS/PHASE 


АЦ 





MEAN CUMULATIVE FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 


10 


0. 


p.00 


- t MEAN WEIGHTED CUMULATIVE FAILURE RATE 
(9 : MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x + MEAN MOOEL FORECAST CUMULATIVE FAILURE RATE 





30. 00 60. 00 90. 00 120.00 _ 1 
ΓΕ ЦЭР Р Ф TEST TIME 


0.00 180.00 210.00 


FIGURE 3.6 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
ΗΠ, ΕΤ UY: IG Ρις, 5 TESTS/PHASE 





1.00 





7 - 1: MEAN ΝΕΙΟΗΤΕΟ CUMULATIVE FRILURE RATE 
= O + MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
= x : MERN MODEL FORECAST CUMULATIVE FAILURE RATE 
| e 
a 
o 
e 
г” 
© 


MEAN CUMULATIVE FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 


10 


0. 





p. 00 
o 
o 


40.00 120.00 150.00 200.00 240.00 280.00 
TOTAL ACCUMULATED EST Time 


ΠΕ 3,9 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
БЕШМӘШН ӘСІ! 5: То PHASES, 5 TESTS/PHASE 


46 





1.00 


. t MERN HEIGHTED CUMULRTIVE FRILURE RATE 





e 

= © а MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
> x : MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 

x 

e 

© 

e 

e 

Г- 

о 


MERN CUMULRTIVE FRILURE RRTE 
0.20 0.30 0.40 0.50 0.60 


10 


0. 





p.00 
o 
o 


8.00 


15.00 24.00 32.00 40.00 48.00 56.00 
RC UA rem TEST TIME 


ο πε ας ιο 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
ο πμ σε ο ΙΒ ΠΠΗΠΕΡ, 5 TESTS/PHASE 


47 





.00 


(9 : MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x : MEAN MODEL FORECRST CUMULATIVE FAILURE ARATE 


0.40 





0.80 


| 
| == 
| - t MERN WEIGHTED CUMULATIVE FAILURE RATE 
X 
m 


0.40 0.50 0.60 0.70 


MERN CUMULRTIVE FRILURE RRTE 


0.30 





0.20 


10 


0. 


- p. 00 
= 
e 


12.00 24.00 36.00 48.00 
το ο AECUMMBEATED TEST TIME 


60.00 79.00 84.09 


τ 5.11 


CUMULRTIVE RELIRBILITY GROWTH MODEL PERFORMRNCE 
Шилэн Sel 72) 16 PHASES, > TESIS/FPHASE 


48 





.00 





ë - ı MEAN WEIGHTED CUMULATIVE FAILURE RATE 
% С) t MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
= x 1 MERN MOCEL FORECAST CUMULATIVE FAILURE RATE 
O 
99 
eo X 
x 
о х 
Г- 
o 


0.50 0.60 


0.40 





MEAN CUMULATIVE FAILURE RATE 


0.10 0.20 0.30 


2-00 
о 
o 


25.00 75.00 [00800 _ 125.00 150.00 175.00 
TOTAL PE CUNUCATEDSTEST TIME 


FIGURE 3.12 


CUMULRTIVE RELIRBILITY GROHTH MCDEL PERFORMANCE 
ΠΠ FETT: bo PHASES, LOTTESTSZFHASE 


6 








o . 1: MEAN WEIGHTED CUMULATIVE FAILURE RATE 
т O + MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
> x + MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
= x 
© 
E 

e 
~ 
© 

© 
e 
cO 
5] 


MEAN CUMULATIVE FAILURE RATE 
0.40 0.50 


0.30 


0.20 


0.10 





p.00 
о 
o 


200.00 250.00 300.00 
TOTAL. RCCUMULRTÉD DS ΠΕ 


ο 15 ο 3 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
ΠΥ ΕΠ» PHRASES, 20 TESTS/PHASE 


356.00 


20 





. 00 


1 


0.40 





MEAN CUMULATIVE FAILURE RATE 
0.40 0.50 0.60 D. 70 
X 
X 


0.30 


0.20 








- 1 MEAN ΝΕΙΟΗΤΕΟ CUMULATIVE FAILURE RATE 
(9 : MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x + MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 





5.00 .00 


10.00 15.00 20.00 25.00 
ο ο Μο ο Ες TEST TIME 


FIGURE 3.14 


CUMULATIVE RELIRBILITY GROWTH MOGEL PERFORMANCE 
ΕΤ: 16 PHASES, 5 TESTS/PHASE 


51 





T 
MERN CUMULATIVE. FAILURE RA Bb. TT 0.90 1.00 


0.30 


0.20 


0.10 


p.00 


х 
х х х x 
X х X x 
ЖІ (59 с 55 с с 5 8 8 5 $ 
© 
© 
- 1 MERN HEIGHTED CUMULATIVE FAILURE RATE 
O +: MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x + MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
10.00 20.00 30. 50.00 60.00 70.00 


00 40.00 
ЕИ Р Оо. 02 [ED TEST TIME 


шиш 0С 2.15 


CUMULATIVE RELIABILITY GAGWTH MODEL PERFORMANCE 
"ΗΠ SET 8: 16 BASES, 10 TESTS/PHRSE 


52 





MERN CUMULRTIVE FRILURE RRTE 
0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00 


0.20 


10 


0. 


p.00 


Q 
ο 
ο 
o 
0X 
ох 
G 
G< 
x 
о 
x 
x 
Οκ 
ax 


~ t MEAN REIGHTED CUMULATIVE FAILURE RATE 
O r MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x : MEAN MODEL FORECAST CUMULATIVE FRILURE RATE 


20.00 40.00 50.00 80.00 100.00 120.00 140.00 
αν ο ο Εν πες. TIME 


FIGURE 3.16 


ΙΙ ο ΠΕ ΠΒ бЕОЫТН МӘПЕ: РЕНРОНМНМСЕ 
ΤΘ σοι ες 20 TESTS/PHASE 


23 








.00 


1 


о - ı MEAN WEIGHTED CUMULATIVE FAILURE RATE 
E O 1: MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x tı MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
© 
со 
e 
AM 
r 
uj 
= 
ασ 
m. 
Wwe 
Es 
aad 
= 
uo 
(2 
ule. 
> O 
= 
CE 
ك‎ 
zs 
50 
C 
= 9 
не = 
9 x 9 9 
о 5 9 9 9 98 9 9 9 9 


0.20 


10 


0. 





22.00 33.00 44.00 S5.00 66.00 77:00 
TOTAL ACCUMULATED TEST TIME 


p.00 


11.00 


FIGURE 3.1/ 


CUMULATIVE RELIABILITY GROKTH MODEL PERFORMANCE 
ІШЕ ОАЕ Ser SONIC PARES, 5 TESTSZPHRSE 


54 





MERN CUMULRTIVE FRILURE RRTE 
20 0.30 0.40 0.50 0.60 0.70 0.80 0.30 . 00 


10 


0. 


p.00 


- t MEAN WEIGHTED CUMULATIVE FAILURE RATE 
с) : MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x + MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 


65.00 130.00 195.00 260.00 325.00 390.00 455.00 
ШЕЗІНІРЕМЕШПИІЕЕТЕЙ TEST. TIME 


Бий 2012: 3.18 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
"ΙΤ ΕΙ (η: 16 PHASES, 5 TESTS/PHASE 


25 





. 00 


1 


с _ + MEAN WEIGHTED CUMULATIVE FAILURE RATE 

% O + MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
= x 1 MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
e 

с 

o 

e 

Гэ 

© 


0.60 





0.50 


MERN CUMULATIVE FAILURE RATE 






=) 

г) 

© 

e 

e 

© 

= 

= à 

ο ο ο το ο πρι νο x <a же 

e 

= 

E3700 52.00 65.00 78.00 91.00 


13.00 26.00 33.00 | 
ИШЕ НЕ ЕИ ЕЕ TEST TIME хто 


ITE O LO 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
πω τα cet 10s Ι5 ΠΠΡΤΕΡ, 10 TESTS/PRASE 


56 








MERN CUMULRTIVE FRILURE RRTE 


0.30 


. 00 


& 20: MEAN WEIGHTED CUMULATIVE FAILURE RATE 

Ж O : MERN MODEL DETERMINED CUMULATIVE FRILURE RATE 
= x : MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
с 

е 

o 

c 

Гэ 

© 


0.50 0.60 


0.49 


20 


0.10 





p.00 
o 
e 


26. 


00 52.00 78.00 104.00. 130.00 156.00 182.00 
IO ο ΕΕ ЕЕ ВИТЕ БИИ ИМЕ «IO 


FIGURE 3.20 


CUMULATIVE RELIABILITT SROWTH MODEL PERFORMANCE 
Ши 10 022 CSPHRHSES, 20 TESTS,PHRSE 


57 





. 00 


1 


. t MERN WEIGHTED CUMULATIVE FAILURE RATE 


C 

= (9 ı MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
= x 1 MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
e 

о 





70 


0. 


0.60 





MEAN CUMULATIVE FAILURE RATE 
0.30 0.40 0.50 


0.20 


10 


0. 


p.00 
о 
© 


18.00 27.00 35.00 45.00 54.00 63.00 
RENATO TEST TEME 


9.00 


ΠΕ. σοι 


Ши НИ 2. Е RELIABILITY GAGNTH MOBEL PERFORMANCE 
Шин єг 1 0097Ё > TESTS/PHASE 


58 





. 1 MERN WEIGHTED CUMULATIVE FAILURE RATE 
с) +: MEAN MODEL GETERMINEG CUMULATIVE FAILURE RATE 
x τι MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 


0.90 





0.40 


MEAN CUMULATIVE FAILURE RATE 
0.50 0.60 0.70 0.80 - ; 


0.30 





0.20 


10 


0 


o 
© 


< 15.00 30.00 {5 50.00 75.00 90.00 105.00 


TOTAL ACCUMULATED BES ΜΕ 


Гї208Г 3.2- 


νη: ВЕГІНӘІГІТІ GRIATH MODEL PERFORMANCE 
ΠΙΕΙ σον lo PHASES, 5 TESTS/PHASE 


59 








MERN CUMULRTIVE FRILURE RRTE 
0.30 0.40 0.50 0.60 0.70 


0.20 


10 


0. 


p. oa 


~ t MEAN WEIGHTED CUMULATIVE FAILURE RATE 
O + MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x : MERN MODEL FORECAST CUMULATIVE FAILURE RATE 





u5.00 54.00 63.00 


18.00 27.00 36.00 5 
он 201020” EST ГІМЕ 


ο 3 


ο ο ο мен вена втеттт бета MODEL. PERFORMANCE 
ο Ξ:Ξ:, νι TG ασε, 5 TESTS/FHASE 


60 








MERN CUMULRTIVE FRILURE RRTE 
0.20 0.30 0.40 0.50 0.60 0.70 0. 80 0. 90 „00 


10 


0. 


p.00 


. 1 MEAN WEIGHTED CUMULATIVE FAILURE RATE 
() : MEAN MODEL DETERMINED CUMULATIVE FRILURE RATE 
х : MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 





13.00 26.00 39.00 52.00 65.00 78.00 91.00 
НЕ НЕРЕЛІШГЕШТЕН” ТЕ57 TIME 


FIGURE 3.28 
ШІНМЕНІТҮЕ RELIAGILITT СВОЯТА MODEL PERFORMANCE 
ОЛОО СЕНИИ 16 PHRSES, 5 TESTS/PHEASE 


6] 





МЕНМ CUMULATIVE FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00 


0.10 


$. 00 


- 1 MERN WEIGHTED CUMULATIVE FAILURE RATE 
O + MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x + MEAN MOOEL FORECAST CUMULATIVE FAILURE RATE 





10.00 20.00 30.00 50.00 60.00 70.00 
TOTRL ACCUMULATED TEST ІШІНЕ 


ο ο. 5.25 


CUMULATIVE RELIABILITY GROWiH MODEL PERFORMRNCE 
Е Εμ ΠΡ o PHHSESS 5 TESTS/PHASE 


62 





00 


i 


. t MEAN WEIGHTED CUMULATIVE FAILURE RATE 





O 
% Mm : MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
5 x +: MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
| 
° 
99 
| о 
e © 


0. 


0.60 


0.50 





MEAN CUMULATIVE FAILURE RATE 
0.30 0.40 


0.20 


10 





p.00 
o 
© 
a 
e 
© 


8.00 12.00 15.00 20.00 24.00 28.00 
Pere SCORE ED TEST TIME 


NE e O 


Би 20422 22 02 т GRONTA MODEL PERFORMANCE 
ΙΗ SE ου 6 PHASES, 5 TESTS/PHRSE 


63 





1200 





a - : MEAN WEIGHTED CUMULATIVE FAILURE RATE 

Ч O : MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
= x +: MEAN MODEL FORECAST CUMULATIVE FAILURE ARTE 
e 

00 

e 

ojo 

© 


MERN CUMULRTIVE FRILURE RRTE 
0.30 0.40 0.50 0.60 


20 


10 


0. 






c. 00 


. 00 90.00 105.00 


30.00 45.00 60.00 75.00 
ОДБИО АЕ ВИ ЕО TIME 


FIGURE 3.2/7 


CUMULATIVE RELIABILITY GROWRTH MODEL PERFORMANCE 
мо 017192 6 РїїН ЕЭ, 5 TESIS/PHASE 


64 








1.00 


0.80 0.90 


RRTE 
0.70 


MERN CUMULRTIVE FRILURE 
0.30 0.40 0.50 0.60 


0.20 


10 


0. 


p.00 


„ t MEAN HEIGHTED CUMULATIVE FAILURE RATE 
O : MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x : MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 





11.00 22.00 33.00 44.00 55.00 
Ши иг 100 ЕР”РЁ5Т TIME 


66.00 77,00 


FIGURE 3.28 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
ЕНІМӘЕН SET MODU: & PHASES, 5 TESTS/PHASE 


65 








MERN CUMULRTIVE FRILURE RRTE 
0.20 0.30 0.40 0.50 0.60 0,70 0.80 0.90 1.00 


10 


0. 


p.00 


. 1 MEAN WEIGHTEO CUMULATIVE FAILURE RATE 
O : MEAN MODEL DETERMINED CURULATIVE FAILURE RATE 
x + MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 


ох 


15.00 . 00 90.00 105.00 


30.00 45.00 60.00 7 
EE NIE TEST TIME 


гс: ис 42229 


ΠΤΙ ΠΕΙ АВТ τς ΟΙΤΗ MODEL PERFOAMANCE 
ο ος SE ποπ. 6 PHASES, 3 TESTS/PHRSE 


66 








MERN CUMULRTIVE FRILURE RRTE 
0.20 0. 30 0.40 0.50 0.60 0.70 0.80 0.90 


10 


0. 


p.00 


~ 1 MEAN WEIGHTED CUMULATIVE FAILURE RATE 
O + MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x : MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 





3.00 


6.00 9.00 12.00 15.00 18.00 21.00 
а есе TED TEST TIME 


FIGURE 3.30 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
' ΠΗ SET MOOG: © PHASES, 5 TESTS/PHRSE 


67 








MERN CUMULRTIVE FRILURE RRTE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00 


10 


0. 


p.00 


- 1 MEAN WEIGHTED CUMULATIVE FAILURE RATE 
O : MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x + MEAN MOCEL FORECAST CUMULATIVE FAILURE RATE 





7.00 14.00 21.00 28.00 35.00 
ТОЕ ACCUMULATED TEST TIME 


42.00 49.00 


917107: 2,31 


Ши G IIVE RELTABSICITY CAGWTH MODEL PERFORMANCE 
CANSA SET MOD?: 6 PHASES, S TESTS/PHASE 


68 








MERN CUMULRTIVE FRILURE RRTE 
0. 30 0.u0 0.50 0.60 0. 70 0.80 0.90 1.00 


0.20 


0.10 


p.00 


. 1 MERN HEIGHTED CUMULRTIVE FAILURE RRTE 
о : MERN MODEL DETERMINEO CUMULRTIVE FRILURE RRTE 
x .і MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 


2.00 12.00 14.00 


1.00 8.00 8.00 10.00 
TOIL мм ТЕР TEST TIME 


Гэ  3-32 


CUMULRTIVE RELIRBILITY GRONTH MODEL PERFORMANCE 
ЕНИБЕН SET MOOS: O PHRHSES, 5 TESTS/PHRSE 


69 





MERN CUMULRTIVE FRILURE RRTE 
0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00 


0.20 


0.10 


- f. 00 


. + MEAN WEIGHTED CUMULATIVE FAILURE RATE 
O +: MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x 1 MERN MODEL FORECAST CUMULATIVE FAILURE RATE 


4.00 24.00 28.00 


8.00 12.00 16.00 20.00 
ПӘН ФИМНЕШИНЕНГЕШ TEST TIME 


FIGURE 3.33 


CUMULATIVE RELIABILITY GROWTH MODE! PERFORMANCE 
шиш от гт ШИВ Б PHASES, 10 TESTS/PHASE 


70 





. 00 


O 
o 
O 
e 
00 
ο Χ 
E x 
x 
= © 2 σ © 
: EMEN ш a 
e 
ан © 
CIS 
(С 
ше 
= 
y 
ασ 
u ب‎ 
Uu» 
ud 
> O 
-- 
ασ 
28] 
22 
50 
O 
> 
ЖО 
ше 
© 
тэ 
e 
о 
e 
o 2 MEAN WEIGHTED CUMULATIVE FAILURE RATE 
(9 τι MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x + MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
e 
%. 00 8.00 10.00 48.00 56.00 


16.00 24.00 32.00 
TOTAL ACCUMULATED TEST TIME 


FIGURE 3. 34 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
Ши: 22010019: 6 PHASES, 20 TESTS/PHASE 


T 





. Q0 


. 1 MERN WEIGHTED CUMULATIVE FAILURE RATE 
O : MERN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x + MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 





MEAN CUMULATIVE FAILURE RATE 
0.30 0.40 0.50 0.60 0.70 0.80 0.90 ! 
G 
3 


0.20 


10 


0. 


p.00 
o 
e 


4.00 .00 24.00 28.00 


8.00 12.00 16.00 20 
гтэ? Оо TEST TIME 


FIGURE 3.35 


CUMULATIVE RELIABILITY GROWTH MODEL PEAFORMANCE 
ο ο FET ποσο Πε», 5 TESTS/PHASE 





MERN CUMULRTIVE FRILURE RRTE 


. 00 


- 1 MEAN WEIGHTED CUMULATIVE FAILURE RATE 
O + MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x : MERN MODEL FORECAST CUMULATIVE FAILURE RATE 


0.90 


20 0.30 0.40 0.50 0.60 0.70 


10 


0. 





p.00 


100.00 125.00 150.00 175.00 
TOTAL ACCUMULATED WEST TIME 


FIGURE 3.36 


ми 0 МЕ ВЕ ТАВ ІТТ ΟΠΟΝΤΗ MODEL PERFORMANCE 
ваша SET 10010: & PHASES, S5 TESTS/PHASE 


73 





1.00 


. 1 MERN ΝΕΙΟΗΤΕΟ CUMULRTIVE FRILURE RATE 


ο 

Ч Ὁ τι MERN MODEL DETERMINED CUMULATIVE FAILURE RATE 
= x =: MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 
e 

е 

2 

e Ф 

3 


0.60 


0.50 





MERN CUMULRTIVE FAILURE RATE 


30 


0.20 0. 


10 


0. 





$. 00 


19.00 21.00 


5.00 9.00 12.00 15.00 
MIRE ον Ματ EST TIME 


FIGURE 3.3/ 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
ο ο SEI ΟΡ 6 PHASES, 5 TESTS/PHRSE 


75 





- : MEAN WEIGHTED CUMULATIVE FAILURE RATE 


e 

E O + MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
= х + MEAN MODEL FORECAST CUMULATIVE FRILURE RATE 
© 

Ф 

о 

9 © 

о 


0.40 0.50 0.60 


MEAN CUMULATIVE FAILURE RATE 


0.30 





0.20 


10 


0. 


-p. 00 


00 42.00 49.00 


14.00 21.00 28.00 35.00 
ΠΟ ША атьЕй0”ГЕЭЗТ TIME 


FIGURE 3.38 


шиш ΤΕ ΠΕ ΠΡΙ ΤΙ GRONTH MODEL PERFORMANCE 
PODIAS. ICO: 6 PHRSES, 5 TESTS/PHRSE 


75 





MERN CUMULRTIVE FRILURE RRTE 
0.40 0.50 0.60 0.70 


0.30 


0.20 


0.10 


p.00 
o 
O 


- 1 MEAN WEIGHTED CUMULATIVE FAILURE RATE 
б) +: MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x 1 MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 


X 


Q 


30.00 50.00 150.00 180.00 210.00 
TOTAL ACCUMULATED TEST MIME 


pr 3.39 


OMORATI VE BEEIBMBILITI GHONTH MODEL PERFORMANCE 
ΕΠΗ зет пеене: 6 PHASES, 20 TESTS/PHASE 


76 





MEAN CUMULATIVE FAILURE RATE 


. 1 MEAN WEIGHTED CUMULATIVE FAILURE RATE 


O 

κ. O : MEAN MODEL DETERMINED CUMULATIVE FAILURE RATE 
Р x +: MEAN MODEL FORECAST CUMULATIVE FAILURE ARTE 
O 

e 

© 

© © 


0.20 0.30 0.40 0.50 0.60 0. 
Ө 


10 


0. 





0.00 
о 
e 


3. 00 


6.00 9.00 12.00 15.00 18.00 21.00 
MI Ор TEST TIME 


FIGURE 3.40 


CUMULATIVE RELIABILITY GRGWTH MODEL PERFORMANCE 
ЕРЕШЕ сГ2776 . 6 PHASES, 5 TESTS/PHASE 


77 





MEAN CUMULATIVE FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.30 


10 


0. 


p.00 


- t MERAN WEIGHTED CUMULATIVE FAILURE RATE 
© : MERN MODEL DETERMINED CUMULATIVE FAILURE RATE 
x 1: MEAN MODEL FORECAST CUMULATIVE FAILURE RATE 


7.00 2.00 {9.00 


14.00 21.00 28.00 35.00 
CONAC ACCUMULATED TEST TIME 


FIGURE 3.41 


CUMULATIVE RELIABILITY GROWTH MODEL PERFORMANCE 
Piet τς συ αι Ὁ PHASES, 5 TESTS/PHASE 


78 





Figures 3.23, 3.24, 3.40, and 3.41 indicate that in instances 
where reliability growth progress patterns are interrupted by a period of 
reliability degradation the cumulative failure rate model lags behind the 
true underlying cumulative failure rate path with both its determined and 
forecast failure rate estimates. While this characteristic might be dis- 
missed as the result of the ''smoothing'' nature of the model, the model's 
failure rate estimates are plotted with the mean test time weighted aver- 
age cumulative failure rate which is itself a ''smoothed'' quantity. Hence, 
the model cannot be excused from failing to accurately portray the tem- 
porary reliability progress decay case. ''least data'' cases (NT, - 5) are 
presented and the performance was no worse for the ten and twenty test 
per phase simulations. The cumulative model failure rate estimates did 
display reliability progress patterns that resembled dampened versions of 
the true underlying cumulative failure rate paths, and the model's esti- 
mates were reasonably accurate for the final cumulative failure rate 
Status. 

b. Variability (Precision) Performance 

Tables 3.3 thru 3.8 present the continuous cumulative failure 
rate reliability growth model's variability performance for determining 
the cumulative failure rate status of a component in a systems acquisi- 


ШЕП Сүсіс. Entries in these tables (P.S.E. TR ) were determined by 
TIS 


equation 3.27. Tables 3.9 thru 3.14 present the cumulative failure rate 
model's variability performance for forecasting the cumulative failure 
rate status of a component one test phase ahead (i+l) of the current test 


phase (i). Entries in these tables (P.S.E.7> ) were determined by 
{ΠῚ . 


equation 3.35. | 


19 





From figure 3.11 the mean model determined cumulative failure 


rate for the sixteenth phase of testing for lambda set 7 using five tests 





per phase was read as M - 0.55. In table 3.3 under lambda set 7, 
16 
phase 16 a value of 25% is entered for P.S.E.TE . Therefore, the 
TT 
standard deviation of the mean model determined cumulative failure 
“> 
rate λττ = 0.45 over one-hundred simulations (NSIMS = 100) was 
16 
255 же 
En 
“<> 16 25 
“<> = ds «αι. = = 
5.0.54 ATT * 7168 О 55 = 1125 (3.36) 
BT 16 
16 
from equation 3.2/7. 
As noted in Chapter I! econometricians and cost estimators 


set goals of 10% to 20% for the percentage standard error measure of vari- 
ability performance of their models. Since gross performance is being 
examined in this thesis, less stringent bench marks may be appropriate 
for evaluating the variability performance of the reliability growth 
models. 

Т a goal of 30% і5 set for the percentage standard error 
measure of variability performance, then a quick method of examining a 
model's variability performance is to determine in each variability per- 
formance table the first test phase at which the percentage standard 
error for all lambda sets (failure rate sets) meets the 30% goal. Тһе 
earlier the test phase number at which this criterion is achieved the 
more confidence can be placed in the precision of the model. As with 
any sampling statistic, increasing sample size is expected to reduce 
Variability. In the reliability testing procedure as the number of tests 
per phase NT. is increased from five to ten to twenty the test phase 


number at which the 30% percentage standard error goal is achieved is 
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therefore expected to occur earlier in testing. 

Tables 3.3 thru 3.14 list the variability performance of the 
continuous cumulative failure rate reliability growth model. In tables 
3.3, 3.4, and 3.5 the cumulative failure rate model's variability perfor- 
mance for determined cumulative failure rate and sixteen phase lambda sets 
achieves the 30% goal at phase 10 for NT. - 5, at phase 6 for NT. - 10, 
and at phase 2 for NT. = 20. The percentage standard error listed for 
phase ] in any of the tables is for the failure rate estimates given by 
equation 3.24 vice for the cumulative model estimates which start with 
test phase 2. As can be seen the equation 3.24 estimates are subject to 
a great deal of variation. Tables 3.6, 3.7, and 3.8 show that in the 
case of the contracted six test phase cycles the cumulative model's vari- 
ability performance for determined cumulative failure rate fails to 
achieve the 30% goal for NT. - 5 and achieves the 30% goal at phase 5 
For NT; = ]0 and phase 3 for NT. - 20. 

In tables 3.9, 3.10, and 3.11 the cumulative failure rate 
model's variability performance for forecast cumulative failure rate in 
sixteen test phase cycles achieves the 30% percentage standard error 
goal at phase 12 for NT. = 5, at phase 7 for NT; = 10, and at phase 5 for 
NT, = 20. Of course forecasts are made for phases 3 and on only. Tables 
3.12, 3.13, and 3.14 show that for the six phase lambda sets the cumula- 
tive model fails to achieve the 30% percentage standard error goal for 
variability performance in forecasting cumulative failure rates. The 
difficulties arise for lambda sets MOD7, MODI2, and MODIA. These are the 
lambda sets for which the mean test time weighted average underlying 
cumulative failure rate decreased most rapidly to approximately 0.20 for 


phase 6 in all cases, and these lambda sets are the ones for which the 


8] 





cumulative model displayed the most difficulty in tracking the underly- 
ШЕ Сипи!атіуе failure rate progress path. Refer to figures 3.31, 3.39, 
and 3.41. Note in table 3.14 (NT. = 20) that the 30% goal was achieved 
in phase 5 but lost in phase 6 for the three lambda sets enumerated 
above. f lambda sets MOD7, MODI2, and MODI were not considered, then 
the 30% percentage standard error goal was achieved in phase 6 for NT; - 
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B. CONTINUOUS INSTANTANEOUS FAILURE RATE RELIABILITY GROWTH MODEL 
l. Model Description 
The continuous instantaneous failure rate reliability growth 
model evaluated is of the form 


_ (1-а)Ь 
ТЕ 


(3-37) 


> 
! 


where 
à = instantaneous failure rate, 
TT = total accumulated test time for all testing, and 
a,b = model parameters that determine the shape of the model 
estimated instantaneous failure rate reliability 
progress path. 
Total accumulated test time TT, the independent variable, is the same 
quantity utilized in the continuous cumulative failure rate reliability 
growth model, equation 3.1. Instead of the cumulative failure rate 
λττ modelled by equation 3.1, the instantaneous model of equation 3.37 
models the unknown, underlying instantaneous failure rate Х, . There- 


fore, rather than producing estimates of the underlying test time 


weighted average cumulative failure rate λττ , the instantaneous model 
Ї 


was used to estimate the actual test phase instantaneous failure rates 


92 





7С 
та 
ас 
σα 
12 
82 
62 
ТЕ 
СЕ 
СЕ 
Lt 
Ον 
27 
ау 
8% 
9 


ЕС 
52 
Gc 
9c 
Le 
82 
62 
pc 
et 
Gt 
LE 
0* 
717 
65 
ди 
СЭ 


52 
b 
S 
92 
το 
BE 
ОЕ 
ТЕ 
£ € 
σε 
Lc 
09 
7h 
65 
LY 
c9 


ες 
τε 
SÉ 
σα 
де 
Se 
Ot 
Ge 
ee 
GE 
ВЕ 
Dy 
27 
Gu 
LY 
22 


Eg 
τε 
$C 
22 
12 
Sc 
DE 
СЕ 
EE 
St 
1٤ 
07 
p 
95 
65 
25 


ЕС 
τε 
σέ 
С 
Ше 
82 
Die 
Ic 


r 


цу 


m 
m m) 


0% 
E7 
GY 
LY 
l9 


GZ 
22 
ас 
20 
12 
82 
Ос 
τς 
Ge 
GE 
LE 
0% 
с? 
GY 
1 
29 


ee 
72 
62 
Зе 
е 
ac 
ЗЕ 
ШЕ 
ΕΕ 
St 
LE 
0.7 
pur 
GY 
Ly 
29 


ве 
£ < 
Ze 
σέ 
De 
14 
6c 
ОЕ 
Ge 
De 
ШЕ 
07 
77 
6% 
8% 
C9 


ee 
за 
ра 
S 
9c 
8c 
6c 
Τε 
212 
σε 
LE 
О? 
7% 
65 
15 
29 


ce 
Ee 
ма 
Gc 
p 
ЖЕ 
6c 
Lt 
СЕ 
σε 
212 
OF 
77 
97 
8% 
co 


EC 
i 
σέ 
9 
ше 
8c 
Ot 
ШЕ 
ВЕ 
σε 
LE 
0% 
77 
65 
1% 
29 


22 
Ба 
ма 
σέ 
DuC 
82 
52 
TE 
ct 
St 
ЩЕ 
0% 
7” 
65 
8% 
29 


om 
ST 
51 
eT 
el 
TI 
ОТ 


83 


Kik Kft Kik жүк ΧΧΧ кж жуя жок ж жж жк жоК ЖКЖ жж 
vt et СТ II OT 6 9 G v Е С I 


Ui 9 
=+ r 


хэс Хо хохо 
135 ΨΥΏΘΗΥῚ 


110} 3un VJ AANIWYILIA “35УЧ4/51531 S *SISVHA 91 
39NVWHO0dH3d ALIITISVISVA TADOW HLMIND ALITIGVIIY JALLVINWAO 


ee Seva 


στά πο MOM TF с O о 


иі 5+ 
ж 
E 
оз 





LT 8I 11 LT LI LT 61 LT 9 T LT on 91 91 


LT 81 LT 11 L1 LT 8I LT LT LT ІТ 11 11 
81 81 81 81 BT 81 81 81 LT 81 LT 8 1 11 
81 81 8t Bl 81 8I 81 81 81 81 81 8I gl 
61 61 6I 61 61 5I 61 61 8I 61 8T 61 8I 
61 5I 6I 0c Oc 61 61 61 61 6 T 61 6 T 61 
0c ог ог Le Ше 02 02 0 € 0c ШЕ 02 02 02 
1 le Te 24 σε ШО Le 12 02 Ша 02 ще 12 
се ες te σα EC са се эс ёс Ç CG Cc Ç Ç 
ша ас ас IC 62 σέ σό σέ ze me ша ас С 
Ще LE S ое 8c 12 Де Ec Де Ec Lc 12 Zac 
Ot ОЕ ος TE τε Ot ος JE 6c Ot Ot oe De 
єє EE e GE Да ВЕ ЕЕ 212 ВЕ ес ЕЕ CE ВЕ 
8t ВЕ 6t ос NS 6c 6t 6t ВЕ 6t 8t 6t 6t 
о η Ou Ди 27 95 p D 9 Χά 7% От 9% 9% 
86 89 89 86 3% BS 86 86 86 86 86 86 86 

-- LS "Sl "A "OT s a. η; a E US To no TM 

135 voanvi 


3108 17164 O3NIWNd3L3O “35 унд/5 1531 CT “535УН4 91 
3INVWYI3IYIA AJITIAVIYVA 13000 НІМ) УӘ AlIlI@VIT3%9 3AILV T WO 


y e gv 


84 


іы: Nm ο Ὁ ο 


+ 
ах 





71 
ет 
€T 
el 
E 
УТ 
SI 
ST 
Эл! 
LT 
51 
Ша 
τς 
ες 
Ec 
C7 


ж жж 
УТ 


cI 
ЄТ 
ЕТ 
СТ 
201 
91 
SI 
ST 
οι 
LT 
6T 
Oc 
Ше 
ЕС 
ща 
eu 


жж жэ 
€I 


уд! ol 
t T ЕТ 
СТ уд! 
91 zin 
УТ үд! 
Y SI 
ST SI 
20 91 
LT LT 
81 81 
61 61 
фа Ше 
те τς 
єс са 
Le ша 
27 C7 
ΓΘ 


31VY 3YN711V3 I3NIW33L30 


ET 
€T 
€I 
үд! 
+41 
var 
GT 
SI 
9 I 
21 
81 
5 I 
Ше 
ee 
12 
cy 


жж ж ж 
OT 


eT 
€t 
£ T 
ГА! 
DE 
ST 
ST 
21 
11 
8 1 
61 
Ord 
Te 
Έτ 
ша 
7 


X x κ ης 
6 


cT 
t 
€T 
7 1 
pu 
ST 
ST 
21 
11 
81 
61 
0c 
Iz 
ес 
ЁС 
Сї 


£ k * £ 


8 
жк жж 
135 


71 €T 
ET el 
71 21 
YI v T 
v "I 
SI s1 
ST ST 
91 2I 
LT LT 
Bl 81 
61 51 
02 02 
ша ше 
pe £ < 
το ще 
e 29 
е 22 
ΥΩ ΒΝ ΥῚ 


21 
e 
ет 
ет 
91 
71 
ет 
51 
LIT 
8 1 
51 
Ос 
IZ 
Se 
Le 
Ç 


жжжж 
6 


“35 УН4/51531 02 


21 21 
ЕТ al 
ЕТ EN 
“1 ЕТ 
“1 oT 
“1 “1 
A E 
91 ST 
LI 11 
81 81 
21 61 
02 02 
12 12 
а єг 
12 12 
2%, 2% 
d o та 
гсасуча 91 


е1 
el 
ЕТ 
уд! 
1 
PT 
SI 
94 
11 
8 1 
61 
02 
ІШЕ 
ç Ç 
12 
Gy 


fer Ж 
2 


З ЭМУУЗО49334 А11118У15УЛ 13108 НЇМО0Н9. А11118УГ1Ү3нН JM LVINWNI 


001 


ZI 
ΕΙ 
el 
el 
51 
vll 
SI 
GI 
11 
81 
6I 
Cc 
Ще 
ee 
22 
аи 


TIT. 
1 


Lu $e 
ut 


91 
ат 
л 
28! 
cil 
TT 
OI 


It =m NM SF NH Ὁ P^ со 


L + 


а.х 


85 





тж 


DAE 
ШЕ 
0% 
(27 
217 


23 


ejt 
ох 


ох 


>} 


+ 
mx 
Ox 


Оз 


ο κ 


Nr 


= 


E 


де 
0% 
27 


"Y Ιω 
ох № 


96 St 96 σε 

БЕ ща Lt LE 

0% 05 05 бс 

CY с” 27 Ty 

997 8” 9*5 95 

G9 49 49 49 
84 11038 3103н 5008 S004 1 
KOK RK 
13S vad 


IVY ЗЯПЛІУ3 03М1М493133 


9% 


6€ 9€ 
LE LE 
CH 0% 
τ» 15 
95 95 
69 69 
xx xx жк жж 
QOW 900W 
ΝΣ 


GE 
ДЕ 
0% 
cv 
LY 
99 


жж жж 
SCOW 


“45уН4/51531 6 
j9NVWuOdJdu3d ALITISVISVA 1300W ΗΙΜΟΝΘ ALITISVI 38 JATLVINWND 


519V1 


96 96 
ДЕ LE 
0% 0% 
27 2% 
9% 19 
59 59 
YOON EON 
'S3S VHd 9 


Gt 
ДЕ 
05 
СУ 
pu 
99 


жжжж 
cQ 0W 


9 £ 
ДЕ 
с” 
ди 
27 
59 


Ἂς ἀκ κκ κ 
TOJN 


86 





12 Gc E ас σέ Lc σέ 
ще Lc 82 LG Lc да ща 
τε ТЕ ТЕ ШЕ ШЕ T€ Te 
σε St σε St σε σε σε 
6t 6t 217 SE 5t 6t БЕ 
97 oF 97 орг. 35 o п? 
Taon ттаои 3103И 5008 BOON ¿QON 9300 

ХОЖЖЭЭ 

135 УОВИУТ 


Gc 
ща 
τε 
σε 
6t 
95 


KK kK 
SOON 


31УЧ 33011973 OININA3L30 *3SVHd/SAS2l OI 
3INVW333834 ALINIGVIBVA TAGOW НІМОМӘ ALINI8V1I39 IJALLVINANI 


1e 380L 


ас σέ 
22 12 
Te T€ 
σε σε 
6t 6t 
D 9v 
5004 00И 
'S3S Vdd 9 


σσ 
Pc 
τε 
σε 
6t 
957 


жжжж 
cQ ON 


ас 
АС 
ТЕ 
σε 
6t 
27 


KK K 
TOON 


87 





тл 

ak Ша 

+ mu 

(ΟΚ 

= t 

(145 

шах Mm 

Ох сп 

> 

NH 

ax م‎ O 
са С 


S1 51 61 51 8 1 5T 81 81 81 61 61 9 
Te ЁС 12 те та Бе ше τό ща 12 те G 
τε ο Ξε 25 ος сг De 22 се ес 24 7 
ас 94 Эс ас σέ σέ 96 Sc 9c бс 92 £ 
5c DIE Ot 62 6c ШЕ 06 422 ος 6c DE с 
Ee ДЕ ДЕ Lt Да 6c LE ШЕ ШЕ ще lt I 
ee ЭЛБИ сы SOON СООН COON TOON 35 YHd 
жок жок жж жожо > 
135 УОВИУ 1 


1115 38011734 Q3NInA3L30 #з5унд/5 1531 02 “535 унд 9 
39NVWu2dU2d ALITISVIWVA 1330W HIMOHU9 ALTTISVI 33 AAT LYIAWND 


86 318У1 


88 





Q Uy T 
N N N 


а пе Фют 
т еш аа m см N N 


цу 


# 
tF iui - Y 0 


mit 9 40 


Ж το 2 12 Бол og Ge το. ο; ыг ME 2 
ae “10 ο -ινς оа ра 92: 52 αι ο .. 
бл νο ος. μα... τον. παῦε е 14 59 5: сс 
п.г а 62 82 16 oz. o б ОШ 
gz 62 of 42 бе е oe oe ac 5 τ...” 
сг Ғғ uc 5 Mar oc τε Oe Te Me 
ic (ecce. TEM Е tt^ бє 2: гс “С πι. -- 
cc νε so ‘yee ieee σε Ge “Ge “тєг. 
DE wie πε LE Be гэ... де πε - 
ὃν δν ο к, t» т» ІІ пі ОО 3: 
ЕЕ 147 ж ч ον, 4 Тэг. е 5. τ; 
ог Га р os 25 Ес σα S UK R EE 
GG с ες 5: с 55 8 5 5 5 22 ы 
2 du — 5! gh "89 "fo ο ου αι. 

ж d η) UI SOR “a j 27 Зүс тг a да SER SNC ` 

135 VOSWY 1 


3178 33(111ү4 16533404 “35УН4/51531 6 'S3SVHd ΟἹ 
39NVWU23d"3d ALIVIAVIYVA VAGOW НІМ289 ALI? IGVI]3U 3AI1 VS ПИПО 


676 318У1 


“+ с + m O ™ o 
89 


uJ μὲ 





ОС 
81 
81 
6 I 
02 
0c 
τα 
ЕС 
72 
€ 
Ot 
7E 
20 
49 


EE: 
VAT 


11 
81 
8I 
61 
61 
0 
12 
ЕС 
Sc 
8c 
Dt 
Gc 
7 
49 


ES 
ЕТ 


22 
0z 
61 
61 
02 
Ше 
сс 
EC 
Ge 
8c 
ШЕ 
Die 
C7 
po 


ж жж 
cI 


8T 

61 
61 

Ше 
012 
Le 
Ce 
Ge 
ас 
8c 
ГЕ 
σε 
CY 
88 


Ж хжж 
TI 


Lil 
8t 
8I 
61 
Oc 
12 
Ç € 
ЫГ 
IE 
8c 
ТЕ 
„да 
6t 
779 


Ж жж 
01 


3178 ЗУП1ТУЗ LSVI3U0J 


LT 
81 
81 
61 
0c 
2 
22 
ec 
SE 
8c 
TE 
St 
157 
79 


Xx xo 
6 


81 те 
81 ог 
6I 0:2 
61 02 
Oc 02 
12 le 
се га 
ЕС єс 
RE зе 
8c 8c 
Ic te 
ЗЕ St 
£ > E 
99 09 
EEK жж ж 
8 1 
[35 VO8HV 


8I 
61 
5 T 
02 
Ju 
ша 
ες 
£ < 
S cC 
82 
ТЕ 
St 
ο. 
09 


ERICH 


9 


11 
ет 
81 
61 
02 
02 
12 
єг 
G2 
82 
Τε 
σε 
уз) 
М9 


ES 


5 


35 уна/5 1531 ОТ 


8t 11 
61 8 1 
04 8I 
0с 61 
02 61 
ша ша 
e Ic 
се 26 
Gc Ge 
8c 8c 
ІШЕ Le 
ge ΠΕ 
1757 Cy 
£9 19 
XC xx E 
v £ 
*S3SVHd 91 


81 
81 
6I 
61 
02 
le 
ες 
€c 
Sc 
8c 
ШЕ 
St 
си 
19 


жжжж 


с 


39NVWUOd93d АІЛЛІЯУІ ЯУЛ 1320И НІМ0ОЧ9 ALT TISVEI38 3AI LV IOWA 


οτε 314У1 


11 
81 
61 
61 
0c 
02 
Ке 
Ее 
ас 
8c 
Τε 
σε 
ри 
ЕР 


жок жок 


1 


91 
ST 
71 
ЕТ 
СТ 
TT 


90 





ST 
EJ 
vi 
51 
он 
SI 
31 
ESL 
8 1 
0c 
c 
De 
Se 
9 


Ж x 
уд! 


ЕТ! 
el 
vI 
УТ 
v 
ST 
9T 
LT 
61 
ше 
ee 
ge 
Ge 
89 


ж жж 


ЕТ 


LI 
ST 
ST 
91 
ST 
91 
91 
81 
61 
Τε 
ЕС 
Sc 
ЩЕ 
М9 


СТ 


zi 
УТ 
S I 
SI 
91 
9 1 
11 
81 
61 
tE 
ЕС 
ас 
0- 
6% 


x< x x< >< Ἂς Χς Ἂς 


11 


ЕТ 
eal 
РТ 
ул! 
ST 
ST 
91 
LI 
81 
onl 
0c 
ше 
ва 
8c 


ж жжжж 


01 


1108 33011У4 15V)39303 


el 
71 
51 
ST 
SI 
20 
9T 
81 
51 
UC 
ес 
22 
12 
07 


TIT 


5 


£ I 
vI 
71 
ST 
ST 
9T 
L1 
8T 
S I 
Bc 
EC 
9c 
Τε 
ες 


Ἂς ἃς XO 


ше о 


L 
Жжжж 
S VOSUN 


LT 
ST 
ST 
ST 
91 
91 
1 
81 
ОС 
ще 
ус 
9c 
ба 
GS 


x x κ < 


жж 
V1 


ZU 
үд! 
221 


py 


5 
91 
91 
LT 
81 
02 
e 
Uc 
92 
ШЕ 


цу 
цу 


« 
9 


жж 


ЕТ 
ESI 
УТ 
71 
GT 
9I 
LT 
81 
ος 
Ç Ç 
ас 


Er 


IE 
49 


KR 


S 


zd Su Cc 


τι el 
7”! ЕТ 
SI УТ 
ST 91 
91 SI 
91 91 
IT 9T 
61 8T 
0c 61 
Ce Ic 
ас ME 
Lc 9€ 
ee Ge 
19 86 
Жжжж жж ж 
7 € 
'S3SVHd 9T 


el 
bu 
vt 
ST 
ST 
91 
11 
81 
61 
12 
ЭЛС 
Te 
Τε 
96 


жж жж 


с 


З ЭМУУ 304934 АЛ ЛТ8УТЗҮЛ 13108 Н1М13Н9 А11118У1134 3AILVIANWAI 


11230001 


ет 
51 
91 
ST 
SI 
9T 
11 
81 
61 
Ша 
y 
12 
СЕ 
65 


жж жс 


I 


9T 
ST 
и 
el 
ет 
TT 


9! 





p 
u Y 


ex 04 o m 
uy ο x 


тж 


17 E9 29 ща 6t І, 69 EN 6€ Е 6t Lv 0% 9 

СУ Y 6% 057 ey οὔ 06 LY 77 ВИ 77 GY Ον 5 

pu OS TS eb 6% со Ва 95 GS 19 TS £6 £ 7 

29 99 69 5% 27 E LL 87 61 98 29 YL 14 е 
ке анан зана таку aptat кеа акак уа 3494 02008 $004  CUOW 004 1004 3S Yid 


Ἂς ἃς жокк к 
135 vagswvi 


3 1Ү3 33011974 15923303 “35УҮН3/651531 6 ‘535 ҮНЯ 9 
39NYW92-293d ALITISVIUVA 1300WN HLMOS9 AIITISVI 139 JAILV'InWno 


ей с 385371 


22 





6c 12 82 62 26 JE LZ 0€ 82 62 82 9 
се Τε εε "t 9€ σε εε GE EE HE EE G 
8€ σε LE 6t 1% 2% БЕ 15 LE 6E 86 b 
95 2 єў Ly 85 85 6% 06 Οὐ 1% 9*5 € 
хх жжжжж жжжжж kK KK X x< * x< жж жж жжж ж x xxx жжжж ж ж ж хжжж KK kK кх жж 
Он 11034 01104 6204 8204 7004 90094 SOOW 59309 саоы 2004 1004 3SVHd 
Ἂς xk ας ἃς Ἂς ας жж 
L3S voauv 


jivy З3ЯЛЛІУ3 15У23804 “35УН3/51531 01 ‘5 35 На 9 
3oNVWu2d9"3d ALITISVISVA 13409 НІМ29Э9 ALIIIAVI 13% SATLVINWND 


ЕШ Co σοι 


93 





ШЕ 
m 


E (O 


r Ç 69 τα Te 
7G Ge 8c € c 
Le 6c бїс Ос 
Le Le Le DE 
ÖN TOON TOON TION O 


3 1үН 33Г11ү4 15733304 


се 
b 
B 
σε 


KEK KI KK 
1109) 621098 


ES +46 
Be 6c 
Ot ЇЕ 
6t 0 7 
кж ә жж 
8390 1068 
ЖЕЖ ak 
135 vagwvi 


ж 
9 


σέ 
12 
ТЕ 
per 


жжж 
GIA 


C C ас 
Sc 82 
06 CE 
17 с? 
сабы 9204 


22 
ас 
8c 
LE 


жж жж 
€ GOW 


4:5 ҮН4/51531 02 'SaSvHd 9 


26 
9c 
Ot 
6t 


ἃς ας x< 
саз 


3oN VWNu2d3d ALITISVINVA 1300W HLMIUD A117119V1 71339 JAILVINWND 


VI E 3107 


(270 
52 
62 
8t 


Xo + 
TOON 3 


E edie 9 


DR 


94 





Х, specified as inputs to the reliability testing procedure computer 
simulation. These are the failure rates of lambda sets contained in 
meples 3.1 and 3.2. 

As can be seen in equation 3.37 and similar to the cumulative 
failure rate model, as total accumulated test time increases instanta- 
neous failure rate is modelled as decreasing. Thus, reliability of com- 
ponents is portrayed as increasing in general. Assumptions regarding 
the signs of the values for the model parameters a and b in the instan- 
taneous model are not as obvious as the assumptions might be for the 
signs of the model parameters Q and В in the cumulative failure rate 
model. 

A mathematical analysis of the instantaneous failure rate model 
is given in reference 2. А Monte Carlo simulation evaluation and com- 
parison of the instantaneous failure rate model is contained in refer- 
ence 5. 

2. Reliability Testing Procedure 

The reliability testing procedure of a system acquisition cycle 
appropriate to the continuous instantaneous failure rate reliability 
growth model is identical to the procedure described for the cumulative 
failure rate model in chapter !11.A.2. Therefore, the test data neces- 
sary for evaluation of the instantaneous model were collected simul- 
taneously with the collection of data for the evaluation of the cumula- 
tive model in a reliability testing procedure as graphically depicted in 
figure 3.1. No additional test results are required for evaluation of 
the instantaneous failure rate model. 

>. Reliability Testing Procedure Computer Simulation 
Since the reliability testing procedure applicable to the con- 


tinuous and instantaneous failure rate models are identical, data for 
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evaluating both models were collected from a single computer simulation 
program as described in chapter |I|l.A.3. Features of the reliability 
testing procedure computer simulation such as phase planned test time 
РТТ, determination and assignment of one-half a failure in those in- 
stances when no failures occurred during a test phase were in affect 
for the evaluation of both the failure rate models. Also, the same 
twenty-eight lambda sets (failure rate sets) given in tables 3.1 and 
3.2 and the same number of simulation replications (NSIMS = 100) were 
utilized for both model evaluations. 
4. Computer Simulation Data Manipulation 

The continuous instantaneous failure rate reliability growth 

model of equation 3.37 may be written as 


-а, 


5: αι) лт (3.38) 


| i 
As noted in equation 3.16 an estimate of the unknown, underlying instan- 


taneous failure rate of a component for any given test phase of a reli- 


ability testing procedure corrected for planned test time bias is given 


by 
oe = "umb 217 (3.39) 
i l] + 2NT. T. | 
E -1,2,3, , K where Т. is the total test time accumulated 
for the number of components NT. tested during the phase and Р. 15 


the number of component failures occurring during the phase. 
If the logarithmic transformation is applied to equation 3.38, 


then 


ln À. = (1-а, )Ь, - a, n ТТ. (3.50) 
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To obtain the ordinary least squares regression estimates for a. and 
Уг 
b. the data pairs (In ds In ТТ.) are employed from the results of the 


reliability testing procedure computer simulation. Let 


-< 
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Цан 
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Ω. 


1Ξ] 
тэ |, 2, 3, , K. Then equation 3.40 becomes 
AO >, (l=a,) - а,Х, (3.41) 
ШЕГІ - 1, 2, 3, ... , К. By the derivation presented in Appendix A the 


ordinary least squares regression estimates for the instantaneous failure 
rate model parameters а. апа b. are 
i i 


>` XY -Ү 3 X, 


(= Sill) eee | ae and (3.42) 


* 





i 
Ξ 2 
#2 A: A 
j=l у=! 
N - - 
= exp (Y. +X.) (3.53) 

1-8, 

for i = 2, 3, 4, ... , K. Note that as with the cumulative failure rate 


model the regression requires at a minimum observations on the results 
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of two test phases; thus, model parameter estimates are made for the 
th : я 
second thru the K. test phase. The instantaneous failure rate estimate 


given by equation 3.39 was used for the first phase of testing; i.e., 


е ут (3.44) 


As the instantaneous failure rate model parameter estimates were 
obtained, they were applied to the model in equation 3.38 to obtain model 
determined estimates for the instantaneous failure rate reliability 


status at the end of each phase of testing; i.e., 


= | 
ο ea br) (3.85) 
Ї 
for i = 2, 3, 4, ... , K. Again, the simulation index r is left impli- 
meme = 1, 2, 3, ... , NSIMS = 100). 


Upon completion of all computer simulations (NSIMS = 100) for 


each specified lambda set, performance statistics were computed as 





B. NS 1MS 
2 Ї p 
ΓΙ НГЕ x s zx (3.56) 
r=] i 





5... = , and (3.57) 
À 
le: 
i 
θε» 
^e 
Ρ.5.Ε. 5 = — M TVc" ,Tp x 100 (3.58) 
Ч ах 
12 
1 
for i= l, 2, 3, ... , K. Also, in order to evaluate the forecasting 


performance of the instantaneous failure rate model the same method of 
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computing an estimate of the total accumulated test time for a one test 
phase in the future failure rate estimate utilized for the cumulative 
failure rate model in equation 3.31 was utilized for the instantaneous 


failure rate model forecasts. Hence, 


^ 
^ч N та, 
ҒА = (1-@.)b.(1T..,) ' where (3.49) 
ipee ГОО] i+] Е 
i+] 
TT E PTT...) ( 
= + 
sig цааш μη ας 3.50) 
РФ 2 3,135, ... , Κ. Note again that forecasts were made for test 


phases 3 thru K as was the case with the cumulative failure rate model. 


Forecast statistics were then computed as 


- NSIMS 
AN ] pA NE 
dug ^ NSIMS 2 en я ? (3.51) 
21 ? 
y NS IMS _ 
] № κο 2 
 ТӘЗИИет2 (Рт Рр. ала (3.52 
T. 20 tr | 
S.D. 
ыг 
Ке. = -- 100 (3.53) 
D x 
We 
| 
nomi = 3, 4, 5, на 


5. Model Performance 
a. Accuracy Performance 
Figures 3.42 thru 3.77 depict the accuracy performance of 
the continuous instantaneous failure rate reliability growth model for 
selected tests per phase NT; cases of the lambda sets listed in tables 


3.1 and 3.2. In each’graph the specified underlying instantaneous 


5/5, 








, solid line), the mean 


model determined instantaneous failure rate Ar from equation 3.46 


і 
(9 , circles), and the mean model forecast instantaneous failure rate 


failure rate А. om Ble 11 OC 3-2 ( 


Жы from equation 3.51 (X , crosses) are all plotted against the mean 

Es accumulated test time pr from equation 3.29 for each phase of 
the specified reliability testing procedure of the acquisition cycle. 
While the specified underlying instantaneous failure rate is plotted as 
a smooth, continuous line for purposes of contrast, it should be noted 
from both figures 3.1 and 3.2 and the testing procedure design that the 
specified underlying instantaneous failure rate is actually a step func- 
tion in shape with discontinuities occurring at the end of each test 
phase. 

Examining figure 3.47 for example at a mean total accumulated 
test time of approximately 205.0 test time units the specified instanta- 
neous failure rate is 0.30, the mean model determined instantaneous 
failure rate is approximately 0.24, and the mean model forecast instanta- 
neous failure rate is approximately 0.19. As noted on the graph the 
accuracy performance plotted is for the lambda set 6, 16 test phase, 20 
tests per phase reliability testing procedure simulation. Since the 
point examined is for the last test phase (i = K = 16), table 3.1] shows 
that for lambda set 6, test phase 16 the specified instantaneous failure 
rate is 0.30 as expected. 

The instantaneous failure rate model frequently yielded mean 
forecast failure rates that were 'off-the-scale'' of the accuracy perfor- 
mance graphs; i.e., mean forecast failure rates greater than 1.0. These 


off-the-scale mean estimates ranged from failure rates only slightly 


greater than 1.0 to mean estimated failure rates of magnitudes in excess 
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of 10°. The extreme values occurred only for the first forecast and 
lou for the second forecast (test phases 3 and 3). Regardless 
of the magnitude of these off-the-scale forecast failure rates, all 
points of magnitude greater than 1.0 меге plotted at 1.0. 

Figures 3.52 thru 3.46 and 3.60 thru 3.64 display the instan- 
taneous failure rate model's performance for the 'nice'' underlying fail- 
ure rate progress paths. The model, while discerning the shape of 
these 'nice' underlying failure rate patterns, is consistently optimistic 
in both determining the current failure rate status and forecasting the 
next test phase failure rate, especially in the case of the longer six- 
teen phase reliability testing procedures. The model performs more 
accurately for the more volatile six test phase procedures (figures 3.60 
thru 3.64) than for the protracted sixteen test phase procedures (figures 
3.42 thru 3.46). In fact mean determined failure rate performance is 
excellent for the shorter six test phase cases. Forecasting accuracy 
typically is off-the-scale for the first test phase improving rapidly 
by the third or fourth test phase. Once stabilized, the mean forecast 
failure rate generally is biased optimistically as expected from the 
method utilized to produce forecasts (equations 3.49 and 3.50). 

In figures 3.47, 3.48, and 3.65 thru 3.67 accuracy of the 
instantaneous failure rate model is displayed for essentially linear 
underlying failure rate progress paths. Again, mean determined failure 
rate performance shows that the model detects the linear shape of the 
progress path with reasonable accuracy but provides consistently opti- 
mistic estimates of the underlying instantaneous failure rate. Forecast- 
ing accuracy, while consistent in the sixteen test phase procedures, is 


very poor being only around 50%-60% of the magnitude of the underlying 
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instantaneous failure rate for the majority of the test phases until 
the final one or two phases. For the six phase procedures forecasting 


performance is extremely erratic as can be seen in figures 3.65 thru 


3.67. In fact forecasting performance actually degrades as more test 
information becomes available in the case of lambda set MOD6; i.e., as 
the number of tests per phase increases from five to twenty (Ντ. E 


vs. NT, = 20, figure 3.65 vs. 3.66). Also, figure 3.67 is for a twenty 
tests per phase (NT. - 20) procedure; and therefore, in keeping with the 
convention established for presenting accuracy performance graphs this 
figure shows the best performance of the instantaneous failure rate 
model for lambda set MOD7. The five and ten tests per phase performance 
for lambda set MOD7 were worse than the performance shown in figure 3.67. 
Figures 3.49 thru 3.52 and 3.69 thru 3.17 portray the in- 
stantaneous failure rate model's accuracy performance for permanently 
stagnated reliability status cases. The most vivid contrast for these 
cases is between situations in which failure rate stagnates at a high 
value (А, = 0.70; figures 3.59, 3.68, and 3.69) versus stagnation at a 
low rate (А. = 0.05; figures 3.52 and 3.71). When the underlying failure 
rate stagnates at a high value, the instantaneous model's mean determined 
failure rate estimates are very erratic (А, = 0.70; figures 3.49 and 
3.68) and the mean forecast estimates are virtually useless from a magni- 
tude consideration being, even once stabilized, approximately 40%-50% 
of the magnitude of the true underlying instantaneous failure rates. 
Note that figure 3.49 is for a best case situation of NT. = 20. Fore- 
casts at best give an indication of stagnation when the stagnation occurs 
at a high true underlying value. In the case of lambda set MOD8 deter- 


mined estimated failure rate improves significantly when more testing 
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is performed; i.e., figure 3.69 versus figure 3.68 (NT. 5. ΝΤ, - 5). 
On the other hand, when the true underlying failure rate stagnates at a 
low point, both the model's determined and forecast accuracy performance 
appear to be excellent (A, = 0.05, figures 3.52 and 3.71, NT, = 5). 
Figures 3.50, 3.51, and 3.70 show for an intermediate stagnation level 
(A, = 0.30) how determined and forecast failure rate performance of the 
instantaneous model transitions from poor to excellent. 

The contrast between the underlying failure rate permanent 
stagnation cases points out a general performance characteristic of the 
instantaneous failure rate model. Because the model produces consistent 
optimistically biased determined and forecast failure rate estimates, as 
the true underlying failure rate progress path approaches low failure 
rates the model's accuracy performance improves significantly by neces- 
sity since the estimates become ''sandwiched' between the low true under- 
lying failure rate and 0.0. This "closing of the brackets'' effect may 
also produce favorable variability performance for the instantaneous 
failure rate model. 

Figures 3.53, 3.55, 3.72, and 3.73 present the accuracy per- 
formance of the instantaneous failure rate model in the case of true 
reliability status progress interrupted by a period of stagnation. Only 
"best case" (NT, = 20) graphs are shown. The model's mean determined 
instantaneous failure rate performance is fair for these cases and con- 
tinues to exhibit consistent optimistic bias. Mean forecast failure 
rates generally are indicative of the underlying failure rate path trend 
only and are significantly off the mark in forecasting instantaneous 
failure rate magnitude. The 'kick-down' in the mean forecast of the 


failure rate for the first phase after the period of stagnation in figure 
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3.53 (test phase ll at approximately 130.0 total accumulated test time 
units) is more pronounced in the five and ten tests per phase (NT, = 5, 
Ши сазез for lambda sets 11 and 12. 

For situations of temporary reliability status degradation 
figures 3.55 thru 3.59 and 3.74 thru 3.77 reveal that in these ''worst 
situation' cases the instantaneous failure model performs surprisingly 
well in discerning the shape of the true underlying failure rate path, 
especially for the twenty tests per phase procedures (NT, = 20; figures 
3.57, 3.59, 3.75, and 3.77). During the period of failure rate degrada- 
tion, the instantaneous model tends to produce determined failure rate 
estimates that overstate the degree of degradation. This is especially 
true in the ''least data'' cases (NT, = 5, figures 3.55 and 3.58) of the 
sixteen phase testing procedures. This characteristic is not as pro- 
nounced for the six test phase procedures (NT, = 5, figures 3.74 and 
3.76). The model's mean forecast instantaneous failure rate estimates 
remain optimistic throughout the periods of degradation, but reflect the 
shape of the true underlying failure rate progress path with very credible 
fidelity. The figure series 3.55 thru 3.57 indicates how mean determined 
failure rate estimating performance improves with additional testing 
(NT, = 5, 10, and 20) while mean forecast failure rate estimating perfor- 
mance is very stable after the third forecast for all test per phase 
sizes. Again, note in figures 3.59 and 3.77 that when the true instanta- 
neous failure rate has decreased to a small magnitude (test phase 16), 
the instantaneous model's determined and forecast failure rate accuracy 
displays significant improvement. 

b. Variability (Precision) Performance 
The variability performance of the continuous instantaneous 


failure rate model is presented in tables 3.15 thru 3.26. ERES in 
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SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 


E . t SPECIFIED INSTANTANEOUS FAILURE RATE 

E O + MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
P x +1 MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 
3 

e 


70 


0.60 0. 


50 


0. 


0.40 


0.20 0. 


10 


0. 





p.00 
° 
o 


40.00 120.00 160.00 200.00 240.00 280.00 
TOTAL ACCUMULATED μυ τι 


T (^ a 
ЖҮ Н SM 
INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
LAMBDA SET 3: 16 PHASES, 5 TESTS/PHASE 


107 





SPECIFIED/MEAN INSTANTANEGUS FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 0. 70 0.80 0.90 1.00 


10 


0. 


p.00 





XXX 


. » SPECIFIED INSTANTANEOUS FAILURE RATE 
O : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x t MERN MODEL FORECAST INSTANTANEOUS FAILURE RATE 


x x © 9 


.00 30.00 60.09 80.00 150.00 180.00 210.00 


TOTRL ACCUMULATED TEST PERNE 


FIGURE 3.45 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
БЕМЕШБЕЗЕТ U: 16 PHASES, 5 TESTS/PHASE 


108 





SPECIFIED/MERN INSTRNTRNEOUS FRILURE RRTE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 80 „00 


0.10 


p.00 


„ * SPECIFIED INSTANTANEOUS FAILURE RATE 
(9 : MERN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x + MEAN MODEL FORECAST INSTANTANEOUS FRAILUAE RATE 





9 x Q Q 9 
. 00 40. 00 80. 00 120. 00 160. 00 200. 00 240.00 280.00 
TOTAL ACCUMULATED TEST TIME 


FIGURE 3.46 


INSTANTANE GUS RELIABILITY GROMITR MGDEL PERFORMANCE 
БӘББВЕНИЗЕТ 5: 16 PHASES, 5 TESTS/PHASE 


109 





0.60 0.70 0.80 0.90 1.00 


NEOUS FRILURE RRTE 


SPECIFIED/MERN INSTRNTR 
0.30 0.40 0.50 


0.20 


10 


0. 


- p. 00 





- 1 SPECIFIED INSTANTANEOUS FRILURE RATE 
O : MERN MODEL OETERMINED INSTANTANEOUS FAILURE RATE 
x ı MEAN MODEL FORECRST INSTANTANEOUS FAILURE RATE 
. 00 30.00 60.00 30.00 120. 00 150.00 180.00 210. 00 


TOTAL ACCUMULATED TEST TTME 


FIGURE 3.4/ 


INSTRNTRNEOUS ñELIRBILITY GROWTH MODEL PERFORMRNCE 
RIMA SET 6: 16 PHRSES, 20 TESTS/PHRSE 


110 





SPECIFIED/MERN INSTRNTRNEOUS FRILURE RRTE 


0.20 


„00 


-1 х х 

^ 204 SPECIFIED INSTANTANEOUS FAILURE RATE 

е O : MEAN MODEL DETERMINED INSTANTANEGUS FAILURE RATE 
= x +s MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 
e 

Qo 

о 


0.40 


0.50 0.60 0.70 
қ” суи A аны Дам SL 
Q 


0.30 


0.10 





O 

e 

*5.00 50.00 100.00 150.00 200.00 250.00 
TOTAL ACCUMULATED TEST TIME 


300.00 350.00 


FIGURE 3.48 


INSTANTANE GUS RELIRBILITY GROWTH MODEL PERFORMANCE 
CANDOR ЧЕТ 7; 16 PHASES, 10 TESTS/PIHASE 





. DO 


x х х 
c 
o 
o 
O 
со 
ce 
u) 
E © 
ÇE 
E Р © o ? 
ша", 5 ¿ a © 5 
aco 
=) 9 © 
η © © o 
а 
шо 
Ос 
23 
© 
ul 
a 
co 
Γεω 
ES 
— 
(Ω 
2 
ш =] 
эг 
Ζ * 
се 
uU. 
> 
с 
Ше Я 
D х х x 
© х 
> ЕХ x x x κ 
ο 
d 
Na 
o 
e 
© _ 1 SPECIFIED INSTANTANEOUS FAILURE RATE 
Q : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x t! MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 
e 
© 
“0.00 20.00 40.00 60.00 100.00 120. 00 140.00 


TOTRL ACCUMULATED TEST TIME 


FIGURE 3.49 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFGRMANCE 
ΠΗ ЕЯ 9: 16 PHASES, 20 TESTS/PHASE 


112 





SPECIFIED/MERN 


1.00 


. 1 SPECIFIED INSTRNTRNEOUS FAILURE RATE 
O : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x . MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 


TANEGUS FAILURE RATE 
0.40 50 0.60 0.70 0.80 0.90 


0.30 


0.20 
х 





e 

e 

9). 00 11.00 22.00 33.00 44.00 55,00 
TOTAL ACCUMULATED TEST TIME 


FIGURE 3.50 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
BOMEBNENSETI 9: 18 PHRSES, 5 TESTS/PHRSE 


65.00 77.00 


113 





0.30 0.40 0.50 0.60 0.70 0.00 0.90 1.00 


SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 


0.20 


. 1 SPECIFIED INSTANTANEOUS FAILURE RATE 
O : MEAN MODEL ОЕТЕАМІМЕО INSTANTANESUS FAILURE RATE 
х 1 MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 





135.00 180.00 225.00 270.00 315.00 
TOTAL ACCUMULATED MEST TIME 


EIGUHE 25 


INSTANTANEGUS RELIABILITY GROWTH MODEL PERFORMANCE 
ΕΠ ЗЕТ 9: 16 PHASES, 20 TESTS/PHRSE 


114 





E - 1 SPECIFIED INSTANTANEGUS FAILURE RATE 

” Ὁ ı MEAN MCOEL DETERMINED INSTANTANEOUS FAILURE RATE 
= x + MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 
e 

ο 

e 

e 

re 

3 


SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 


10 


0. 





e 

e 

4 

SS о 65.00 195.00 260.00 325.00 396.00 455.00 
TOTAL, ACCUMULATED TEST TIME 


EIGURMRE πας 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
ο ος ΕΕ τος 16 FRASES, 5 TESTS/PHASE 


1 





SPECIFIED/MERN INSTRNTRNEOUS FRILURE RRTE 


0.20 


1.00 


- 1 SPECIFIED INSTANTANEOUS FAILURE RATE 
O : MERN MODEL OETERMINED INSTRNTRNEOUS FRILURE RATE 
x 1 MERN MOOEL FORECAST INSTANTANEOUS FAILURE RATE 


0.50 0.64 0.70 0.80 0.90 


0.40 





0.30 


10 


0. 








35.00 70.00 


105.00 140.00 175.00 
Pops ACCUMULATED TEST TIME 


саас 3.33 


INSTANTANEQUS RELIABILITY GROWTH MODEL PERFORMANCE 
ΕΤ; lo PHASES, 20 TESTS/PHASE 


210.06 245.00 


116 





SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 


. 00 


„ 1 SPECIFIED INSTANTANEOUS FAILURE RATE 
O + MERN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x 1 MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 


0.20 0.30 0.40 0.50 0.60 0.20 0.80 0.80 


10 


0. 





$. 00 





60.00 120.00 0.00 240.00 300.00 . 420.00 


TOTAL AC CUMULATED TEST ТӘУЕ 


FIGURE 3,4 


INSTANTANEOUS RELIABILITY GROHTH MODEL PERFORMANCE 
ΗΠ 5ΕΤ І2: 15 PHASES, 20 TESTS/PHASE 


117 





. 00 


1 


. 1 SPECIFIED INSTANTANEOUS FRILURE RATE 
O : MERN MODEL DETERMINED INSTRNTRNEOUS FRILURE RRTE 
x + MEAN MODEL FORECAST INSTANTRNEBUS FRILURE RATE 


0.90 


0.60 0.70 0 
A a 
9 
Ө 
G 


0.40 





SPECIFIED/MEAN INSTANTANEGUS FAILURE RATE 





e 
о? 
o 
9 
i 9 9 5 x 

си 2 x © 
= x 

х 
e 
о 
O 
E 

ΠΩ. e 

ED. ЕА 54.00 63.00 


18.00 27.00 35.00 45.00 
TOL НСЕФИФЕНТЕШЕТЕЗТ TIME 


ЫНА; 2,5265 


INSTANTANEOUS RELIABILITY GRÓWNTH MODEL PERFORMANCE 
EDS SET 13: 16 PHESES, 5 TESTS/PHRSE 


118 





SPECIFIED/MEAN INSTANTANEGUS FAILURE RATE 


0.20 


. 00 


= x 

o . 1 SPECIFIED INSTANTANEOUS FAILURE RATE 

h. Ὁ 1 MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
P x 1 MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 
e 

о2 

© 


0.60 0.70 


0.50 


0.40 





0.30 


10 






e 

© 

5.00 20.00 40.00 60.00 80.00 100.00 120.00 140.00 
Ши ас ЭЕ Р”ТЕЗТ TIME 


FIGURE 3.96 


INSTANTANEGUS RELIABILITY GROWTH MODEL PERFORMANCE 
ШЕННЕН тэ 107Ра 5 5, 10 TESTS/PHASE 


119 





RATE 


SPECIFIED/MERN INSTRNTRNEOUS FRILURE 


0.20 


1.00 


201 SPECIFIED INSTANTANECUS FRILURE RATE 


O 
- û а MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
= ж а MEAN MODEL FORECAST iNSTRNTRNEDUS FRILURE RRTE 
| 
© 
© 
e 
e 
r 
о 


0.40 0.50 0.60 


0.30 





0.10 











- p. 00 


0 105.00 


70.0 140.00 175.00 210.00 295.00 
Το ΑΕ ου με TEST TIME 


FIGURE 3457 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
BENE SEN 13: 16 PHASES, 20 TESTS/PHASE 


120 





SPECIFIEO/MERN INSTRNTANEOUS FAILURE RATE 


0.20 


х 
~ t SPECIFIED INSTANTANEOUS FAILURE RATE 
O +: MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x τι MEAN MODEL FORECAST IMSTANTANECUS FAILURE RATE 


0.70 


0. 





ce 

e 

ЕП 00 13.00 26.00 39.00 52.00 55.00 78.00 $1.00 
TOTAL ACCUMULATED TEST TIME 


καπως Binge 


INSTANTANEQUS RELIABILITY GAOWTH MODEL PERFORMANCE 
Шин oe 1U: 16 PHASES, S TESTS/PHRSE 


124 





1.00 


X 
| . 1 SPECIFIED INSTRNTANEOUS FRILURE RRTE 
O + MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x а MEAN MODEL FORECAST INSTANTAHESUS FAILURE RATE 


0.90 


0.80 


70 


0. 


0.60 


0.50 

SERE E μια 
X Б 
X 

X 


0.40 


ӘРЕСІРТЕП/МЕНМ INSTANTANEOUS FAILURE RATE 


0.20 





e 

© 

^5.00 55.00 110.00 165.00 2 
TOTAL ACCUMULATED 


λέω I 


шэг ил ЕЭ EL IPBIPITIY CRORTH MODEL PERFORMRNCE 
ο. ὃς set ти; 16 PHRSES, 20 TESTS/PHASE 


122 





1.00 


. t SPECIFIED INSTANTANEOUS FAILURE RATE 
O : MEAN MODEL DETERMINED INSTANTANEGUS FAILURE RATE 
x + MEAN MODEL FORECAST INSTANTANEGUS FAILURE RATE 


SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 


10 








-. 00 
о 
e 
S 
© 
© 
N 
O 


. 00 30. 00 40.00 50.00 60. 00 70.00 
TOTAL ACCUMULATED TEST TIME 


FIGURE 3.60 


INSTANTANEGUS RELTASILITY GROWTH MODEL PERFORMANCE 
ια. ο 21001: 5 RMASES, SWESTS/PHASE 


123 





.00 


1 


= _ 1 SPECIFIED INSTRNTRNEGUS FAILURE RATE 
Е: O + MEAN MODEL DETERMINED INSTANTANEGUS FAILURE RATE 
> x 1 MERM MODEL FORECAST INSTANTANENUS FAILURE RATE 
© 
00 
e 
LL 
ь- 
GE 
c A 
ы” > 
со 
= 
24 
cc 
Lo 
со 
No 
=) 
e 
uJ 
z 
TO 
— 
zo 
а 
> 
0? 
т © 
“эр СЭ 
эг 
Z ° 
=° 
لا‎ © 
= 
3 
Wien = 
ше © 
= © 
үү © 
"- 
О < 
na 7 
e 
= 
o 
e 
© 
75.00 4.00 24.00 28.00 


8.00 12.00 16.00 20.00 
ο ο ο ТЕН ρου ΤΗΕ 


e s mo Ol 


ШОО ον πε πο ΤΕ GON TH MODEL PERFORMANCE 
ο πω 10 2 6 PHRSES5 5 TESTS/PHRSE 


124 





1.00 


- 1 SPECIFIED INSTANTANEGUS FAILURE RATE 
O r MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x : MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 


0.70 


0.80 6.90 
n  --———— —— ЭНЭ o 
Q 


0.60 


0.40 


0.50 
IAE e AE E. a 


SPECIFIED /MERN INSTANTANEOUS FAILURE RATE 


0.20 


10 


cp. 00 


. 00 15.00 90.00 505.00 


30.00 45.00 80.00 75.00 
πο ΑΓ πο МЕНЕ EST TIME 


FIGURE 3.62 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
Ip SET NOD: 6 PHASES, 5 TESTS/PHPSE 


125 





0.60 0.70 0.80 0.90 1.00 


NEQUS FAILURE RATE 


SPECIFIED/MEAN INSTANTA 
0.30 0.40 0.50 


0.20 


10 


0. 


p.00 


. 1 SPECIFIED INSTANTANEOUS FAILURE RATE 
O + MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x + MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 





„00 11.00 ааа 33.00 44.00 55,00 65.00 77.00 
0Т 


De nera TESI. TIME 


FIGURE 3.63 


INSTRNTRNEOUS RELIRBILITY GROWTH MODEL PERFORMANCE 
шиш р ΠΠΠΗ: © PHASES, 5 TESTS/PHASE 


126 





STANTANEGUS FAILURE RATE 


SPECIFIEO/MEAN IN 


1.00 


S eee a gg тэ 
е 


- | SPECIFIED INSTANTANEOUS FAILURE RATE 
GO : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
х 1 MEAN MODEL FORECAST INSTRNTANEOUS FAILURE RATE 


0.40 0.50 0.60 0.70 0.80 : 0.90 


0.30 


0.20 









15.00 30.0 


0 15.00 60.00 75.00 105.00 
OL BCC UT OER EDT TEST TIME 


FIGURE 3.04 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
SUS SET MODS: G PHASES, 5 TESTS/PHASE 


127 





SPECIFIED/MERN INSTANTANEOUS FRILURE RATE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 .00 


10 


0. 


p. 00 


. 00 3.00 


~ : SPECIFIED INSTANTANEOUS FAILURE RATE 
(9 : MERN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
х 1 MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 


6.00 9.00 12.00 15700 18.00 21.00 
TOTAL AECUNULRTEU TEST TIME 


FIGURE 3.65 


[NSTRNTRNEOUS RELIRBILITY GROWTH MODEL PERFÜORMRNCE 
Шог 0 6: 6 PHASES, 5 TESTS/PRASE 


128 





0.60 0.70 0.80 30 


NEGUS FAILURE RATE 


TA 
S0 


SPECIFIED/MERN INSTAN 
0.30 0.40 0. 


0.20 


0.10 


p.00 


. 00 C ROD 22.00 33.0 


- 1 SPECIFIED INSTANTANEOUS FAILURE RATE 
O : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x 3: MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 





0 44.00 55.00 66.00 77.00 
Toes eC Cree ТЕ УТ ФТ TIME 


FIGURE 3.66 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
ΓΑΜΟ Ρα SET М006: 6 PHASES, 20 TESTS/PHRSE 


129 





.00 


_ t SPECIFIED INSTANTANEOUS FAILURE RATE 
O + MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x : MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 


SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 
0.20 0.30 0,40 0.50 0.60 0.70 0.80 0.90 


10 


0. 








p.00 
o 
o 


30.00 


60.00 90.00 120.00 150.00 180.00 210.00 
ΠΠ ACCUROLRATEOTEST TIME 


FIGURE 3.6/ 


[NSTRNTRNEOUS RELIRBILITY GROWTH MODEL PERFORMANCE 
ΙΕ! 10077 6 PHASES, 20 TESTS/PHASE 


130 





. 00 


FR RE RATE 
0 ИИ ИО а ΜΟΝ ΤΩ 0.80 0.90 1 


0.10 


cp, 00 


х 
© 
© 
© 
o 
Ф ° 
x 
x 
x 
. 1 SPECIFIED INSTANTANEOUS FAILURE RATE 
(9 : MERN MODEL DETERMINED INSTRNTRNEOUS FRILURE RRTE 
x + MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 
. 00 2.00 12.00 14.00 


4.00 6.00 8.00 10.00 
TOTAL ACCUMULATED TEST TIME 


FIGURE 3.68 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
ΠΟΠ SET μον 6 PHASES, S TESTS/PHASE 





SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 


0.20 


00 


0.90 


0.80 


O 
Ж на ны. A A 9 
2 © 
© х 
e 
о 
e 
e 
2 
e 
O 
т 
e 
x 
X 


0.30 







. t SPECIFIED INSTANTANEDUS FAILURE RATE 
O + MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x 1 MEAN MODEL FORECAST INSTRNTRNEOUS FAILURE RATE 






e 
e 
%. 00 8.00 48.00 56.00 


16.00 24.00 32.00 u0.00 
TOTOC ACCUNUCATEOETESIT TIME 


FIGURE 309 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
LAMBDA SET MODS: 6 PHASES, 20 TESTS/PHASE 


132 





0.60 0.70 0.80 0.90 


NEQUS FAILURE RATE 


SPECIFIED/MEAN INSTANTA 
0.30 0.40 0.50 


0.20 


10 


D. 


c, 00 


. 1 SPECIFIED INSTRNTRNEOUS FRILURE RRTE 


ŒM : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x : MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 
© 
x 
2 
O o © © 
х 
х 
x 
. 00 4.00 12.00 0.00 24.00 28.00 


8.00 16. 00 2 
TOTALE AC 2 то. T TIME 


FIGURE 3.70 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
Шил ΕΙ 1009: OTPHBHSES, о PESTS7PHRSE 


133 








. 1 SPECIFIED INSTRNTRNEOUS FRILURE RATE 
O +r MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x r MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 


SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0. 90 


10 


0. 









-p. 00 





25.00 125.00 


50.00 75.00 100.00 
1 871 DIE 82455 2020). r oI TIME 


FIGURE 3.71 


INSTANTANEGUS RELIABILITY GROWTH MODEL PERFORMANCE 
ЕНМӘШЕ SET 0040: 5 PHASES, STTESTSZPHASE 


150.00 175.00 


138 





SPECIFIED/MERN INSTRNTRNEOUS FRILURE RRTE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00 


10 


0. 


p.00 


х 


- 1 SPECIFIED INSTANTANEOUS FAILURE RATE 
O : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x + MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 





o O 
X 
. 00 12.00 24.00 60.00 72.00 84.00 


TOTAL ACCUMULATED TEST TIME 


FIGUHE 3/2 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
LRMBOR SET M0OD11: 6 PRASES, “20 TESTS/PHASE 


135 





SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0. 90 


10 


0, 


- p. 00 


- t SPECIFIED INSTRNTRNEOUS FRILURE RATE 
O + MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x : MERN MODEL FORECRST INSTRNTRNEOUS FRILURE RRTE 


Ж 
9 
9 
с Ф 
x 
. 00 30. 00 60. 00 90. 150.00 180. 00 210.00 


00 120.00 
TOTAL ACCUMUCATEDETEST TIME 


FIGURE 34/3 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
ΗΠ SET MOUic2: 6 PHASES, 20 TESTS/PHASE 


136 





0.60 0.70 0.80 0.90 1.00 


90 


SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 
0.30 0.40 0. 


0.20 


10 


η. 


$). 00 


. 00 3.00 


. 1 SPECIFIED INSTRNTRNEOUS FRILURE RATE 
Ὁ : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x з MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 


X 





6.00 9.00 12.00 15200 18.00 21.00 
Ши 2 ст ΠΊΗΕ 


FIGURE 3. 74 


INSTANTANEGUS RELIABILITY GROWTH MODEL PERFORMANCE 
ΠΠ, 00019: 5 PHASES, 9 TESTS/PHASE 


137 





SPECIFIED/MEAN INSTANTANEOUS FAILURE RATE 
0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 . 00 


10 


0. 


$). 00 


. 00 13.00 25.00 39. 


. t SPECIFIED INSTANTANEOUS FAILURE RATE 
O : MERN MODEL DETERMINED INSTANTANEOUS FRILURE RATE 
x + MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 





00 52.00 85.00 78.00 91.00 
TOTAL ACCUMULRTED TEST TIME 


plebs 3.10 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
ὑπ σα SEI οι 6 PHHSES, ¿0 TESTSSPHASE 


138 





. t SPECIFIED INSTRNTRMEOUS FRILURE RRTE 


о 
: o : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
= x + MEAN MODEL FORECAST INSTANTANEOUS FAILURE RATE 
e 
aa 
o 
LLJ 
Е- 
τ 
E Е 
TUM 
eco 
EJ 
EJ 
СГ 
че ® 
Mo 
=) 
e 
ul 
= 
ELO 
Run ы 
Zo 
сг 
= 
2 x 
= Cc 
=P 
Z Ф 
сә x 
UJ 
= 
2 
ше, 
ге i 
C 
a 
US х 
E Ф 
= х 
о 
e 
= 
“0.00 7.00 14.00 21.00 28 42.00 49.00 


. 00 35.00 
TOGEL APECUMUCATED TEST ΤΠΕ 


“αρα ἃ 8 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
CAMBOA SET MOONY: 6 PHRSES, 5 TESTS/PHRSE 


139 





1.00 


- 1 SPECIFIED INSTANTANEOUS FAILURE RATE 
с) : MEAN MODEL DETERMINED INSTANTANEOUS FAILURE RATE 
x +: MEAN MODEL FORECAST INSTANTRNEQUS FAILURE RATE 


0.90 


SPECIFIED/MERN INSTRNTRNEOUS FRILURE RRTE 
0.20 0.50 0.40 0.50 0.60 0.70 0.80 


0.10 


-p. 00 
o 
e 


30.00 60.00 90.00 120.00 150.00 180.00 210.00 
TOTAL RCCUOULATED TEST TIME 


FIGURE 3.77 


INSTANTANEOUS RELIABILITY GROWTH MODEL PERFORMANCE 
ΠΠ SET πο αν 6 PHASES, 20 TESTS/PHASE 


140 





these tables are the percentage standard errors as computed in equations 
3.48 and 3.53. From figure 3.47 the mean model determined instantaneous 
failure rate was read as 0.24 for the sixteenth test phase of the lambda 
set 6, 16 test phase, 20 tests per phase reliability testing procedure. 

In table 3.17 the percentage standard error corresponding to the sixteenth 
test phase of the lambda set 6, NT. - 20 simulations is 252. By equation 
3.48 the standard deviation of the instantaneous failure rate model's 


determined instantaneous failure rate for this phase is then 


> 5 А 
IS a С 059576 — 55) 


A quick examination of tables 3.15 thru 3.26 reveals that the 
goal of 302 percentage standard error of failure rate estimates utilized 
in evaluating the variability performance of the cumulative failure rate 
reliability growth model (chapter I11.A.5.b.) will be too restrictive for 
evaluating the instantaneous failure rate model's variability performance. 
Also, unlike the variability performance of the cumulative failure rate 
model which almost uniformly improved as test phases of the testing pro- 
cedure were completed, variability performance of the instantaneous model 
oscillates for many lambda sets. For example, keeping in mind that model 
variability performance begins with the percentage standard errors re- 
corded for phase 2, the instantaneous model's variability performance for 
lambda set 1, five tests per phase, determined failure rate in table 3.15 
improves steadily from 76% in phase 2 to 38% in phase 11. In phase 12 
the model's variability performance jumps up to 41%, improves back to 
32% by phase 14, and finally, climbs to 35% for the last test phase, 


phase 16. 
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This oscillation in the variability performance of the in- 
stantaneous failure rate model means that even if a reasonable percent- 
age standard error benchmark is selected, determining the first phase 
for which variability performance on all lambda sets is within the goal 
does not guarantee the performance goal will be satisfied for all subse- 
quent test phases of the acquisition cycle. 

Tables 3.15, 3.16, and 3.17 display the instantaneous failure 
rate reliability growth model's variability performance for determined 
instantaneous failure rate estimates for the sixteen test phase proce- 
dures. If a percentage standard error goal of 40% is set, the goal is 
never achieved for NT. = 5 or NT. = 10 (tables 3.15 and 3.16), but is 
achieved for NT. νυ таБ е 3.17 om testmpiases 5, /, 9, 14, and 16. 
Again, the oscillating character of the instantaneous model's variability 
performance is displayed by this method of examination. Tables 3.18, 
3.19, and 3.20 show that in the case of the contracted six test phase 
procedures the instantaneous failure rate model's variability performance 
for determined instantaneous failure rate fails to attain the 40% goal 
for all simulated tests per phase specifications; i.e., NT, = 5, 10, and 
20. 

In both the sixteen and six test phase reliability testing 
procedures determined failure rate estimates given by the instantaneous 
model were least accurate for lambda set 8 and MOD8. See figures 3.49, 
3.68, and 3.69. Also, the model's accuracy performance for these lambda 
sets was the only case in which no definite bias trend was evident. The 
instantaneous failure rate model's variability performance for determined 
instantaneous failure rate estimates is almost uniformly the worst for 


lambda sets S and MODS as evidenced in tables 3.15 thru 3.20. This was 
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to be expected based on the model's accuracy performance for these par- 
ticular specified underlying instantaneous failure rate paths. 

Tables 3.21 thru 3.26 contain variability performance results 
of the instantaneous model's forecast failure rates for both the sixteen 
and six test phase reliability testing procedures. Percentage standard 
error entries of 10002 indicate that the actual percentage standard 
errors in these cases were greater than or equal to 10002. As with the 
cumulative failure rate model, lambda set 7, 12, 15, MOD7, MODI2, and 
MODIAà provide difficulty for the instantaneous model. These lambda sets 
are the ones which take the most rapid 'plunge' to a low specified instan- 
taneous failure rate of Хүр = 00500 ος. E 0.0500. Again, if these 
lambda sets are not considered, then a 40% percentage standard error goal 
is achieved on phase 14 for NT. = 5 and 10 and on phase 11 for NT, = 20 
in the case of the sixteen phase reliability testing procedure simula- 
tions. The instantaneous model's variability performance for forecast- 
ing during six test phase cycles is very poor achieving the 50% goal on 
the last test phase of the ''most data'' case (NT, = 20) for only seven of 


the fourteen lambda sets. 


C. DISCRETE RELIABILITY GROWTH MODEL 
1, Model Description 


The discrete reliability growth model evaluated is of the form 


u 1 1 
а 7 7 exp (5-8 807 (3.56) 


where R = component reliability after the ns modification of the 
component 
m = number of modifications that have been made to the component, 
and 
a,8 = constants that determine the change in the model estimated 
component reliability as modifications to the component are 
accomplished. 
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The modification number m takes on values 0, 1, 2, . . . with m2 O 
designating the original version of the component. Component reliability 
Ro may be thought of as an instantaneous or modification reliability as 
opposed to a cumulative or average reliability since it is the intrinsic 
reliability of the mid modification version of the item rather than a 
characteristic reliability for all m+] versions of the item that have 
been produced. Under the assumption of reliability growth, the quantity 
exp (a + 8m) in equation 3.56 is expected to increase as modifications 

to the component are made which hopefully improve its reliability. Hence, 
as modifications are accomplished the fraction l/exp (a + Bm) in equation 
3.56 decreases and component reliability increases toward the maximum 
reliability of 1.0. The model is considered discrete since the single 
independent or control variable m, modification number, is discrete as 
opposed to a continuous variable such as total accumulated test time. 

A mathematical analysis of the discrete reliability growth model 
is given in reference 1. Other Monte Carlo simulation evaluations and 
comparisons of the discrete model are contained in references 5 and 9. 

2. Reliability Testing Procedure 

For the discrete reliability growth model the appropriate reli- 
ability testing procedure of a system acquisition cycle is one in which 
modifications to an item are made as a specified number of failures of 
the item are observed during the testing procedure. The modifications 
of the item are made to improve reliability and hopefully result in such 
improvement. Modifications are indexed by m with a total of NTM modi- 
fications being considered during an acquisition cycle; i.e., m 0, Т, 
2, 3, ... , NTM. The total number of item failures that are observed 


Е th -— 5 
during testing of them modification version of an item before the item 
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is modified again is denoted by Dime . The total number of item fail- 
ures BUE is specified before reliability testing is conducted and may 
be varied from modification to modification. During testing of each 
modification version of an item, an underlying, inherent reliability 
that is unknown to the project managers/contractors is present in the 
item. The underlying modification reliability of the В modification 
version of the component is denoted as R 

Between each failure of the mi modification version of an item 
a number of tests of the item are conducted which are denoted as E 
і.е., the number of tests run on the md modification version of the 
item between the men failure and the pen failure. DE . includes 


5 


the Деп failure. 50, NT | is the number of tests performed thru the 
first observed failure of the item when the underlying modification reli- 
ability is га : UT is the number of tests performed from the first 
failure thru the second failure of the item while the underlying modifi- 
cation reliability remains К and so on. After ΝΤΕ failures of the 
item under test are observed, a modification is accomplished and the 
underlying modification reliability of the component changes to Seh 
Therefore, the failure number index j runs from 1 to NTF for each 
modification m ; i.e., NS CE EM МАЦА . All Ale are 
random variables and cannot be specified beforehand. This is quite dif- 
ferent from the testing procedure for the continuous reliability growth 
models evaluated where the number of tests per test phase were specified 
prior to any testing being performed. 

Figure 3.78 is a schematic diagram of the discrete model reli- 


ability testing procedure. Тһе total number of modifications МТМ and 


the total number of failures permitted before modification Ντε are 
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specified prior to testing. The number of tests performed between fail- 
ures ЫГ | for each modification version of the item under test consti- 
tute the data collected from the reliability testing procedure. As with 
the continuous reliability growth models the most salient feature of the 
computer simulation of the discrete model reliability testing procedure 
is that the analyst also specifies the underlying modification reliability 
В that is effective for each modification version of the item. Thus an 
accurate assessment of the accuracy of the model can be made because the 
Du values are known. 
3: Reliability Testing Procedure Computer Simulation 
a. Summary 

The reliability testing procedure appropriate to the discrete 
reliability growth model was simulated on the Naval Postgraduate School 
W. R. Church Computer Center's ІВМ 360/67 System utilizing standard com- 
puter simulation techniques. Reliability testing procedure design para- 
meters NTM апа NTF were specified along with various underlying modi- 
fication reliability sets. Tests of components were then simulated with 
component success or failure being determined for each test based on the 
appropriate underlying modification reliability R. . Number of tests 
between failures ur data were collected as each procedure simulation 
was accomplished. Simulations of reliability testing procedures for each 
specified modification reliability set were replicated one-hundred times 
in order Ёо assess the discrete reliability growth model's variability 
performance. 

After the reliability testing procedure simulations were com- 
pleted, discrete reliability growth model estimates of the underlying modi- 


fication reliability of the component were produced based on the simulated 
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test data by computations utilizing ordinary least squares regression 
techniques to estimate the model parameters a and В . Mean and 
variability statistics of the model reliability estimates were then com- 
puted to permit performance evaluation of the discrete reliability 
growth model. 
b. Detail Description 

The computer simulation of the reliability testing procedure 
appropriate to the discrete reliability growth model was initiated by 
reading in the following reliability testing procedure design specifi- 
cations: NTM, the total number of modifications to be made for the 
acquisition cycle under consideration; ШИ, the total number of failures 
of the ща modification version of the item to be observed until the 
ae modification ts made; в the underlying, intrinsic modification 
reliability of the πο, modification version of the item; and NSIMS, the 
number of times the specified reliability testing procedure was to be 
simulated. For this thesis NSIMS was always specified as one-hundred 
Simulations. 

After specification data were read into the computer, uniform 
(0,1) random variates were drawn in sequence corresponding to component 
tests starting for the modification 0 type component; i.e., uniform 
random variates were drawn in sequence and indexed as U .. form=0, 
eee ss, NIMs j = |, 2, 3, --. ; NTF 5 ашиг 2-1, ... starting 
with the “ор test. 

Each uniform variate was then compared with the appropriate 
underlying modification reliability К to determine if a success or a 
failure occurred during the test. The number of tests re and the 


number of failures accumulated NF data were recorded after each simu- 


lated test such that 
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NT. ; = NT. | + 1 (NT incremented by one test), and (3.57) 
E FOU c СВА success) 
m Mm, j,i m 
NF = (3.58) 
m 
ΝΕ +1 if U_..>R_ (failure) 
m Ш 20-21 
АНГ |!, 2, ... , ММ: | -1, 2, 3, -.. , ΝΤΕ апс P=: 213, 


If the test was a success, then the simulation proceeded to the next 
test. If the test was a failure, then the number of failures accumulated 
ΝΕ, was compared to the total number of failures unti! modification 
ШЕ. to determine if a modification was appropriate. If ΝΕ, was less 
than NTF , testing continued for the given modification and number of 
tests were then counted until the next failure; i.e., EN 22: NF 


was equal to Шын , then a modification of the item under test was simu- 


lated and testing continued for the next modification; i.e., NF and 


m+! 


Ni being tallied next. 


Testing in this sequence was simulated until NE тм was equal 


to NTF ITM which signalled the termination of a given reliability test- 
ing procedure computer simulation. The simulation resulted in the number 
of tests until a failure NI data being recorded for m= 0, 1, 2, 

Enc 3nd |» 1,2, 3, ... , Ντε, . These data constituted the total data 
gathered from a single computer simulation of the discrete model reli- 
ability testing procedure for a single specified underlying modification 
reliability progress path; i.e., a specified set of reliabilities which 
shall henceforth be referred to as a reliability set. The reliability 
testing procedure was then replicated one-hundred times (r = 1, 2, 3, 


NSIMS = 100) such that reliability testing procedure results data were 


actually indexed as ΝΤ, s Since ten reliability sets were utilized 
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for evaluating the discrete reliability growth model with three different 
total number of failures until modification ШЕ specified for each 
reliability set, 3000 reliability testing procedures were simulated for 
the discrete reliability growth model evaluation. 
h. Computer Simulation Data Manipulation 

The discrete reliability growth model of equation 3.56 is proposed 
as a model of the unknown, underlying modification reliability Ro IE 
trinsic to a component as it proceeds thru a system acquisition cycle. 
It is against this true reliability К that the model's performance was 
measured. 


Equation 3.56 may be given in the form 


К = 1 - exp (-a- Bm) or (3-59) 

exp (-a- 8m) = 1 - R (3.60) 
ШЕШІП - 0, I, 2, ... , NTM. The logarithmic transformation of equation 
3.60 yields 

a+ Bm). = -In(l - RJ). ΘΙ 

(а + 8т), ΠΠ 3.61) 
πο |І, 2,... , NIM and j = 1,2, 3, ... , NTF 


An unbiased estimator of the quantity a+ 8m is given in 
reference | as 


02 0211 NT. j = 1 (first test was failure) 


2 


а + в) = Bp 
1 1 1 Е => 
то I ax M. 2 
m, j 
for m = @, li 22 °... 2 МТМ апа j m 2 2) 55 жо» ШШЕ 
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By equation 3.61 


SR) . = (a + Bm). (3.63) 


m, ) LEN 


ЕЕ 0, 1,2, ... , NTM and j 51,2, 5, ... , ШІ” . From this 


relation an average estimate may be computed as 


NTF 
om 
Enea) = lo + gm) = == у? Eo (3.64) 
mm m NTF. ШЕ 
ШЕ 
Letting 
i - си щори 5 
then equation 3.61 may be written as 
N N 
ЩЕ = an + В т (3.65) 
Eun - 0, 1,2, ... , NIM which is of the form Ү = а + ВХ. Applying 


ordinary least squares regression estimates as given in reference 5, the 


α and B estimates are 
m m 


5 ------------ and (3.66) 
(i - m)° 
i20 
SR M E 
o 7Y-8 m ЕС) 
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for m2 1,2, 3, ... , NIM where 


and (3.68) 


m. 
m+] 


Ms 


I 
© 


1 
Цаа 


(3.69) 


Ms 


I 
O 


7О7 апа > estimates are utilized in the discrete re- 


Finally, these a 
liability model, equation 3.56, to produce the model estimates of the 


unknown, underlying modification reliability. These estimates are given 


by 
л | 
Ци --:------------ (3.70) 
22-01 т 
exp ( UE. m) 
for m2 1,2, 3, ... , NTM. Note than since the regression procedure re- 


quires a minimum of two observations, model reliability estimates are pro- 
Саад гот the first modification thru the last modification (NTM). A 
reliability estimate for original version of the component is derived 

from equation 3.56 and 3.64 as 


^ч 1 


Ro 7 ] = с ———————— = Е (Seva) 
exp (a + em) ᾿ 


Again, since the reliability testing procedure was simulated one- 
hundred times (r » 1, 2, 3, ... , NSIMS = 100) for each reliability set, 
one-hundred estimates of the modification reliability were obtained for 
each modification version of the component under test. The mean value, 


standard deviation, and percentage standard error of these estimates 
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were computed as 





- NSTIMS D , (3.72) 





1 ~ ет 22 
лы J с ——— 2 
De Rar Ra and (3.73) 
E r=] 
SD 
АЗЕ =e 5 1110 (3.78) 
т — 
R 
m 
πο 1, 2, , NTM 


To examine the discrete reliability growth model's forecasting 
capability a next modification reliability forecast was made for modifi- 
cations m = 2, 3, 4, , NTM. Forecasting started for the second 
modification since model parameter estimates were not available until 
testing under the first modification was completed. No forecast was made 


past modification NTM because there would be no underlying modification 


reliability with which to compare. Forecasts were made as 


ос ) 
u (3.75 


Em = 2, 3, 4, ...- , NIM. Finally, forecast modification reliability 
statistics similar to the determined modification reliability statistics 


in equations 3.72, 3.73, and 3.74 were computed as 


-. NSIMS 
2 ] ^ч 
Да  NSIMS > E (3.76) 
r=] 
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I f sei Жо pes 
m =] 
л 
per 
EN. -——— х 100 (3.78) 
m “^ч 
FR 
m 


ИП - 2,3, 4, ... , NTM. 

To evaluate the discrete reliability growth model ten reliability 
sets were formed for use as the specified underlying reliability progress 
paths. These reliability sets are listed in table 3.27. All ten reli- 
ability progress paths start at a relatively low reliability of 0.200 


for the original version of the component under scrutiny; i.e., R. = 0.200 


0 
for reliability sets | thru 10. The paths display reliability progress 
that ranges from extremely rapid reliability growth (reliability set 1; 


E 0.200, R 


0 - 0.925) to linear growth (reliability set 6; R =R + 


] m+ | m 


0.150) to permanently stagnated reliability progress (reliability set 10; 
A thru R, = 0.200). Reliability progress was simulated only for compo- 
nents that were modified a total of five times during the acquisition 
Sele; i.e., NIM = 5 and m= 0, 1, 2, 3, 4, 5. Each reliability set 
progress path was simulated for three different total number of failures 
ПИ modification specifications; i.e., ΗΕ = 1, 3, and 5 failures 
which were held constant from modification to modification. 
5. Model Performance 
a. Accuracy Performance 
Figures 3.79 thru 3.98 present all the cases (ten reliability 


sets) of the discrete reliability growth model's capability to determine 


and forecast the unknown, underlying modification reliability progress 
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path during a reliability testing procedure for total number of failures 
until modification Ντε. = ] and 5. These Эс display the ''least data'' 
and 'most data'' cases which can be contrasted for change and improvement 
as the testing sample is increased. For the NIE = 3 cases, the accu- 
racy performance fell uniformly between the NTF = | and NTF = 5 accu- 


racy performance. 


The graphs depict the specified true underlying modification 





reliability R progress path ( , solid line), the mean model deter- 


mined modification reliability m from equation 3.72 for each modifica- 
tion version of the component under test (0 , circles), and the mean 


model forecast modification reliability FR from equation 3.76 for the 
second thru the final modification version of the component (X , crosses) 
plotted versus the modification number m 0, 1, 2, 3, 4, 5. Note that 
the point plotted for the mean model determined modification reliability 
of the original version (m = 0) of the component under test is not model 
determined; rather, it is the mean value of the estimate given by the 
estimator of equation 3.71. This point allows the accuracy of the reli- 
ability estimator utilized to be examined also. 

To illustrate those quantities graphed in the accuracy per- 


formance figures, observe on figure 3.83 that for the third modification, 


was 0.90, the mean model deter- 


the specified underlying reliability Ra 


mined modification reliability (7 was approximately 0.86, and the mean 
— 
model] forecast modification reliability FR made from the second modi- 


3 


Fication was approximately 0.77. Since this graph is for reliability 
set 3, referring to table 3.27, the specified modification reliability 
for the third modification of reliability set 3 is 0.900 as is graphed 


on figure 3.83. Finally, note on figure 3.83 for the unmodified version 
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of the component tested (m = 0) that the reliability estimator of equation 


oS 
3.71 produced a mean estimate А of approximately 0.175 for the true 


© 


underlying reliability Да ог 0.206к 
| With the exception of reliability set 9 (figures 3.95 and 

3.96) the discrete model ТОО ake the shape of the underlying reliability 
progress path with very good accuracy. Forecasting accuracy, while fairly 
good for the "nice"! reliability progress path sets ]| thru 5, displays 
difficulty with the anomalous reliability progress paths characterized 

in reliability sets 6 thru 10. The discrete model occasionally produced 
negative mean forecast estimates of reliability. The negative mean fore- 
cast reliability estimates, the magnitude of which never exceeded 0.20, 
are plotted as 0.0 on the accuracy performance graphs. For example see 
figure 3.97 for mean forecasts at modifications 2, 3, and h. No negative 
mean forecasts of reliability were produced when the total number of 
failures until modification was specified as five (NTF = EM NEUE 
"most data’' case. 

The discrete model accuracy performance graphs display the 
marked improvement that takes place both in determining and forecasting 
reliability status as the specified total number of failures until modi- 
fication ας is increased from one to five which essentially increases 
the test data which the model can utilize. The improvement in accuracy 
is also displayed in the ΝΤΕ, = 3 accuracy performance graphs which are 
not presented. The reliability estimator of equation 3.71 displays the 
same improvement in accuracy when the testing sample size is increased 
as may be seen by examining the graph pairs for ΠΕΡ = | and ΠΠ ш б 
at the modification m = 0 point. 

Figures 3.79 thru 3.98 reveal that the discrete reliability 


model's accuracy performance for determining the underlying reliability 
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is in general slightly pessimistic in the instances when mean estimates 
аге пої "оп the money'! as in figures 3.84 and 3.86. Except for the re- 
liability sets 1 and 2, ντε. = 5 cases shown in figures 3.80 and 3.82, 
mean model forecasting accuracy tends to run from slightly pessimistic 
as in figure 3.90; reliability set 6, DS - 5 to grossly pessimistic as 
аге 3.91]; reliability set 7, Е = | ог figure 3.97; reliability 
set 10, NTF = 1. The general trend evidenced by the graphs is that 

the less test data S las (Nurs = ]) the more pessimistic the mean 
model estimates, determined or forecast. The same is true of the reli- 
ability estimator of equation 3.71. 

Reliability set 9 which characterizes a reliability growth 
pattern interrupted by a period of reliability degradation is the only 
set with which the discrete model experiences a significant problem. 
While not detecting the full magnitude of the degradation, the model's 
mean determined reliability estimates do display the period of degrada- 
tion credibly. See figures 3.95 and 3.96. However, the model's mean 
forecast modification reliability estimates are quite contrary to the 
true underlying reliability progress path. The significant problem 
being that the period of degradation is not forecast until the true under- 
lying reliability status has recovered from the period of degradation and 
is in fact displaying significant reliability growth. This behavior is 
apparent even for the ''most data'' case ΠΡ = 5 in figure 3.96. While 
model forecasting capability suffers іп the ''least data'' case for reli- 
ability set 10, NTF = ], the discrete model copes with permanent reli- 
ability stagnation satisfactorily as seen in figures 3.97 and 3.98. 

b. Variability (Precision) Performance 
Tables 3.28 thru 3.33 present the discrete reliability growth 


model's variability performance for determining and forecasting 
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the reliability status of a component as it undergoes modification in a 
system acquisition cycle. Entries in the tables are percentage standard 
errors as computed in equations 3.71 and 3.78. For example from figure 


3.83 the mean model determined reliability for modification 3 from reli- 


ability set 3 was found to be E ЕШБІР Іп Еле NTF, = | case. From 
table 3.28 the percentage standard error P.S.E.— corresponding to this 
3 


mean model determined modification reliability is 20%. Therefore, by 
equation 3.74 the standard deviation for the observed mean model deter- 


mined reliability is 


ә-зң В. х------ - 0.86 х-— = 0.172. (3.79) 


In. tables 3.28, 3.29, and 3.30 the discrete model's vari- 
ability performance for determining modification reliability status is 
displayed for the specified total number of failures until modification 
cases of one, three, and five failures, respectively. Two salient 
characteristics displayed by the results are (1) the large variability 
of the estimates produced by the reliability estimator of equation 3.7] 
and (2) the large variability of the reliability estimates produced by 
the discrete model for reliability set 10, the permanently stagnated 
reliability case. The same difficulty is displayed to a lesser degree 
for reliability set 7. | 

If reliability set 10 is not considered, then a goal of 40% 
percentage standard error is achieved by the discrete reliability growth 
model on the fifth modification for the NTF = ] and 3 cases and on the 
fourth modification for the NTF = 5 cases. If reliability set 7 is 


also dropped from consideration, the 40% goal is achieved on the fifth 
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modification for ATE = ], on the third modification for NTF = 3, and 
on the second modification for NTF = 5. Note that the reliability 

sets characterizing temporary reliability stagnation and degradation 
(sets 8 and 9) did not have to be taken out of consideration in order to 
find variability performance at a reasonable level. 

Tables 3.31, 3.32, and 3.33 present the discrete model's 
variability performance in forecasting the reliability of the subsequent 
modification version of the component under test for the ШЕ. = |, 3, апа 
5 cases. Again, the worst variability performance occurs for reliability 
sets 7 and 10. Dropping reliability sets 7 and 10 from consideration, a 
40% percentage standard error goal is achieved only in the case of 
NTF = 5 at the fourth modification. Hence, variability performance of 
the discrete reliability growth model for forecasting is not particularly 


good. 
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ο ο... ο οσο κε RATE RELIABILITY 
GROWTH MODELS COMPARISON 

Codier in reference 2 gives a derivation in which an equation of the 
form of the continuous instantaneous failure rate reliability growth 
model (equation 3.37) is obtained by differentiating the equation of the 
continuous cumulative failure rate reliability growth model (equation 
3.1) with respect to the total accumulated test time TT after substitu- 
tion of the cumulative failure rate estimator of equation 3.13. The 


derivation essentially proceeds along the following line: 


λττ Ξ = = ἘΠΕ ; therefore, (4.1) 
EL (4.2) 
Now, 
ΤΕ | 9 (lea), ια. -Q 
STD or (8ТТ ) = (l-a)BTT ~ , and (4.3) 
_ 9TF 
Ar Sr. (В.Д) 


Hence Codier derives an equation 


Ax n (1-a)8TT * (5.5) 


and claims that the equation is the continuous instantaneous failure 


rate model 


λτ S3 τησ ze, (5.6) 
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equation 3.37. The implication being that the cumulative model parameters 
о and B are equivalent to the instantaneous model parameters a and 
b, respectively; and so, once either а and B or a and b have 
been estimated, it is unnecessary to estimate the other parameter pair. 
The cumulative and instantaneous failure rate models were considered 
as two unrelated models which were proposed to model different aspects of 
reliability growth from the viewpoint of this thesis. The evaluation of 
the two models was conducted accordingly. In order to investigate the 
proposition that the cumulative and instantaneous models are related thru 
equivalence of model parameters a hybrid cumulative failure rate model was 
devised that utilized the parameter estimates generated for the instanta- 
neous failure rate model. Also, a hybrid instantaneous failure rate 
model was devised that utilized the parameter estimates generated for 
the cumulative failure rate model. Specifically, the hybrid cumulative 


failure rate model is given by 


7S πο Ut (4.7)‏ = ف 


where E : and > „p Were determined by the instantaneous failure rate 
2 2 


model equations 3.82 апа 3.53. The hybrid instantaneous failure rate 


model is given by 


N > лт ІШІ 
27 їе ie Sir шив хэ 


where © = апа бу ° were determined by the cumulative failure rate 
3 , 


model equations 3.21 and 3.22 after appropriate transformations given 


in chapter |11.A.5. 
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As cumulative and instantaneous failure rate model parameter esti- 
mates were determined for each phase of each simulation for the differ- 
ent lambda sets they were applied to the hybrid models as well as to 
their appropriate models. Hybrid model estimates of the cumulative and 
instantaneous failure rates were recorded and the standard statistics 
of chapter III were compiled. 

Table 4.1 contains the mean cumulative and instantaneous determined 
failure rate estimates produced by the hybrid models for the lambda set 
3, ten tests per phase (NT. = 10) case listed with the appropriate under- 


lying mean test time weighted average cumulative failure rates p 
Ї 


(equation 3.30) and the specified underlying instantaneous failure rates 
À. aie sabe Lambda set 315 one of the “пісе! failure rate sets 
for which both the cumulative and instantaneous failure rate models dis- 
played some of their best accuracy and variability performance (see 
ο 3.5, 3.6, 3.7, and 3.44; and tables 3.4 and 3.16). Entries of 
10.0000 for the hybrid cumulative model mean determined cumulative failure 
rate in table 4.1 indicate that the actual mean estimate was greater than 
or equal to 10.0000. 

The performance of the hybrid models displayed in table 4.1 for a 
"nice" lambda set is typical of the behavior of the hybrid models for 
all the lambda sets, nice or anomalous. The hybrid cumulative model 
(instantaneous model's estimated parameters substituted into the cumula- 
tive model) produced failure rate estimates of magnitude greater than 
10.0 for the first few test phases followed by very erratic estimates 
(including negative mean estimates) which displayed no relation to the 
mean test time weighted average cumulative failure rates supposedly being 


modelled. On the other hand the hybrid instantaneous model (cumulative 
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TABLE #.] 


HYBRID CUMULATIVE AND INSTANTANEOUS FAILURE RATE MODEL SIMULATION RESULTS 
LAMBDA SET 3: 16 PHASES, 10 TESTS/PHASE 


MEAN TEST HYBRID HYBRID 
TIME CUMULATIVE INSTANTANEOUS 
WEIGHTED MODEL MEAN MODEL MEAN 
AVERAGE DETERMINED SPECIFIED DETERMINED 
CUMULATIVE CUMULATIVE INSTANTANEOUS INSTANTANEOUS 
FAILURE FAILURE FAILURE FAILURE 
PHASE RATE RATE RATE RATE 

| 0.7000 0.6702 0.7000 0.6702 

2 0.4703 10.0000 0.3530 0.3605 

3 0.3565 10.0000 0.2380 0.3058 

4 0.2863 10.0000 0.1800 0.2669 

5 0.2392 10.0000 0.1450 0.2362 

6 0.2064 -0.1003 0.1220 022108 

7 0.1818 Ё 2! 0.1060 0.2016 

8 0.1625 -0.0171 0.0933 0.1889 

9 0.1474 -0.0065 0.0837 0.1796 

10 0.1346 0.0532 0.0760 0.1684 

11 0.1244 -0.0206 0.0697 0.1626 

12 421152 Ш 0257 0.0644 0.1548 

13 0.1076 0.0070 0.0600 0.1497 

14 0.1009 0.259] 0.0562 0.1442 

15 0.0952 0.0518 0.0529 0.1502 

16 0.0900 0.0060 0.0500 0.1357 
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model's estimated parameters substituted into the instantaneous model) 
produced what appeared to be a good failure rate estimate for the first 
one or two phases (i = 2, 3; models do not estimate for the first phase) 
but quickly transitioned to a dampened, sedate pattern of estimates which 
was very unresponseive to even the most radical variations in the under- 
lying instantaneous failure rate progress path. Also, the hybrid in- 
stantaneous model's failure rate estimates after the second or third 
phase generally exhibited increasing magnitude error except for crossing 
Situations in the cases of temporary stagnation or degradation of the 
specified underlying instantaneous failure rates. 

Regarding the negative failure rate estimates produced by the hybrid 
cumulative model (instantaneous model parameters in cumulative model), 


the following observations on the parameter estimates 5. and A 


г „Г lr 


of the continuous instantaneous failure rate model were made during the 
reliability testing procedure computer simulations. During the simula- 


; 1 : жә 
tions the magnitude of the parameter estimate а. _ маз continually very 


2 


close to 1.0 often being more or less than 1.0 only in the tenth, 


eleventh, or twelfth decimal place. From the instantaneous model equa- 


ο 


2 


tion 4.6 it can be seen that logically if the estimate is less 


than 1.0, the E 5 estimate should be positive; and, if the “ау A esti- 


2 2 
E 


3 


mate is greater than 1.0, the estimate should be negative in order 


to produce positive estimates of the instantaneous failure rate. Exactly 


such behavior was observed during the computer simulations; as the 


magnitude of the С. 3 estimate moved to either side of 1.0 the sign 


3 


of the 5 Е estimate would ''flip-flop' accordingly. Of course if a 


negative “` А estimate is plugged into the cumulative failure rate model 


2 


for 8 in equation 4.1, a negative estimate of the cumulative failure 
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rate necessarily results no matter what the sign or magnitude of the 


a, estimate which is substituted for a (save a value of , = о), 
Hence, it is very plausible for the hybrid cumulative model to have pro- 
duced negative estimates of cumulative failure rate. 

In contrast to the hybrid cumulative model's erratic failure rate 
estimates the hybrid instantaneous model (cumulative model parameters 
in instantaneous model) produced failure rate estimates which, after one 
or two test phases, displayed a ''sluggish'' growth pattern and generally 
increased in magnitude error from the underlying instantaneous failure 
rate À; being modelled. This situation is not surprising because the 
cumulative model parameters being employed in the hybrid instantaneous 
model are parameters utilized in modelling a ''smoothed'' quantity, the 
underlying cumulative (average) failure rate that is collectively charac- 
teristic of all the versions of an item tested thru a given point in the 
acquisition cycle. As the history of the item stretches farther and 
ihe (total accumulated test time TT increases) the cumulative 
failure rate of the item becomes increasingly insensitive to the current 
instantaneous failure rate intrinsic to the item. Hence, the parameters 
of the cumulative model likewise become increasingly insensitive to the 
current instantaneous reliability status. When these relatively stable 


parameters are utilized in another mode! whatever its form, ''smoothed'' 


stable output is reasonably expected. 
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V. EVALUATION SUMMARY AND CONCLUSIONS 


This thesis examined three reliability growth models for which accu- 
racy, precision, and robustness characteristics were investigated over a 
wide variety of true underlying growth patterns, both ''nice'' and anomalous. 
The evaluation of a continuous cumulative failure rate model, an instanta- 
neous failure rate model, and discrete reliability model was accomplished 
by computer simulation of reliability testing procedures that were appro- 
priate to the reliability growth model types for a systems acquisition 
cycle. Performance of the models both in tracking and predicting true 
underlying reliability progress patterns was measured for mean accuracy 
and Variability (precision) over progress patterns which included most 
Situations that can be encountered, both good and bad. The models! per- 


formance characteristics are summarized in the following paragraphs. 


A. CONTINUOUS CUMULATIVE FAILURE RATE RELIABILITY GROWTH MODEL 

The continuous cumulative failure rate model examined generally dis- 
played very good to excellent accuracy performance in tracking both ''nice'' 
and anomalous true underlying cumulative failure rate patterns. Тһе 
cumulative model did exhibit difficulty in determining and forecasting 
true underlying patterns that characterize rapid reliability growth 
(failure rate decay) in the latter phases of the systems acquisition 
cycle. The difficulty was evidenced by mean model determined/forecast 
cumulative failure rate estimates that diverged from the true underlying 
values on the pessimistic side; thus, the cumulative model provided esti- 


mates that could be considered as upper bounds on failure rate in this 
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situation. The other anomalous situation with which the cumulative model 
experienced difficulty in tracking and predicting accuracy was one of 
reliability growth interrupted by a period of reliability degradation. 
The modelled cumulative failure rate path both lagged the true underlying 
cumulative failure rate path and failed to reflect the full magnitude of 
the failure rate degradation. Thus dependence on the ا‎ in his situ: 
ation could hamper response to the degradation by giving a ''too little 
too late'" signal of the problem. The cumulative model coped with true 
underlying cumulative failure rate patterns that were permanently stag- 
nated quite adequately. 

As the reliability testing procedures of the acquisition cycles com- 
pleted more test phases, the cumulative model's variability (precision) 
performance improved uniformly for both ''nice' and anomalous true under- 
lying failure rate paths. Variability percentage standard error goals 
were satisfied earlier and earlier in the acquisition cycle as more 
testing data was made available to the model. This good variability 
performance provides a degree of confidence in employing the cumulative 
failure rate model in actual systems acquisition pragrams where the 


intrinsic cumulative failure rate status is truly unknown. 


B. CONTINUOUS INSTANTANEOUS RAILURE RATE RELIABILITY GROWTH MODEL 

The continuous instantaneous failure rate model examined, while 
exhibiting the capability to track and predict the shape of various 
unknown, underlying instantaneous failure rate path types with very good 
accuracy and robustness, consistently produced optimistically biased 
estimates of the instantaneous failure rate. If bias must be accepted 


in a reliability growth model, then pessimistic bias is preferred to 
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Seeimistic bias. Consistent pessimistic bias permits managers to utilize 
the model produced estimates as lower bound type values and have confi- 
dence that reliability status is being observed from the ''right side of 
the fence''. On the other hand consistently optimistic model produced 
estimates impart a great deal of uncertainty as to how bad reliability 
status might be and what degree of corrective action is required. 

The anomalous situations in which the instantaneous mode! experienced 
difficulty in tracking and predicting the shape of the true failure rate 
path were (1) the initial period of recovery in reliability growth after 
a period of temporary reliability stagnation, (2) permanently stagnated 
reliability growth at high failure rates, and (3) reliability growth in- 
terrupted by a temporary period of reliability degradation. |n the case 
of temporary reliability degradation the instantaneous model charted a 
determined failure rate path that was an exaggeration of the underlying 
instantaneous failure rate path; i.e., the periods of growth were displayed 
optimistically and the period of degradation was portrayed to a magnitude 
greater than it was in truth. The instantaneous model's forecasts, while 
accurately capturing the shape of the underlying progress path, were con- 
sistently optimistic during the period of degradation. 

The instantaneous model's accuracy performance was generally better 
for contracted acquisition cycles and suffered when the reliability test- 
ing procedure was extended to encompass a large number of test phases. 
Because of the model's consistent optimistic bias, accuracy performance 
improved as the true underlying failure rate decreased thereby ''sandwich- 
ing'' the model estimates between the true failure rate and 0.0. Also, 
the instantaneous model routinely furnished ''off-the-scale'' forecasts for 
the first one or two phases of an acquisition cycle. 

Тһе instantaneous model's demonstrated capability to determine and 


forecast the true underlying reliability status was overshadowed by its 
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poor variability performance which (1) never achieved a really comfort- 
able percentage standard error goal uniformly for all failure rate pat- 
terns simulated and, more damaging, (2) oscillated as test phases of the 
reliability testing procedure were accomplished. Because of this poor 
variability performance, the instantaneous failure rate model cannot be 


employed by itself with any degree of confidence. 


DISCRETE RELIABILITY GROWTH MODEL 

The discrete reliability growth model examined generally displayed 
very good determined reliability accuracy performance even for the most 
restricted test data cases. Slight pessimistic bias was demonstrated for 
model determined reliability status while a greater magnitude of pessi- 
mistic bias was present in model forecast reliability. Again, pessimis- 
tic bias is favored over optimistic bias in charting a reliability prog- 
ress path. The degree of pessimism in determined and forecast reliability 
decreased markedly as more test data on each modification version of an 
item were gathered. |n cases of limited test data the discrete model 
often forecast negative estimates of reliability for the early modifi- 
cation versions of a component under test. 

For the anomalous situation of temporary reliability degradation the 
discrete model (1) failed to determine the full magnitude of the degrada- 
tion and (2) provided reliability status predictions that lagged the 
true underlying reliability path outcomes significantly. In actual test- 
ing this performance characteristic would give a delayed signal of a 
situation that required corrective action. Also, gathering additional 
test data failed to remedy this deficiency in the discrete model's per- 


formance. 
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Variability performance of the discrete model, while generally good, 
revealed difficulty with the permanently stagnated reliability case and 
the case of rapidly increasing reliability during the latter modifica- 
tion versions of an item. Variability performance improved uniformly for 
all progress path characterizations as more modifications of the item be- 
ing tested were кекетті гінде Also, variability goals were satisfied 
earlier in the acquisition cycle as more complete testing was accomplished 
on each modification version of the item. This nice behavior of the dis- 
crete model lends confidence to its utilization; and therefore, the dis- 
crete model is preferred to the continuous instantaneous failure rate 
model for obtaining a measure of the current or ''instantaneous'' reli- 


ability status of an item proceeding thru an acquisition cycle. 


D. GENERAL OBSERVATIONS 

For determining current reliability status it may be suggested that 
rather than employing the reliability growth models, why not utilize the 
point estimators of reliability status which were used to provide data 
to the models? Although the performance of the point estimators appro- 
priate to each reliability growth model were only observed at one point 
for each model in the reliability testing procedure simulations (first 
phase of testing or mod O version of a component), at that point the 
estimators displayed very poor variability performance upon which the 
reliability growth models improved rapidly and significantly which tends 
to negate any confidence in utilizing the point estimators based on their 
good accuracy performance. 

In retrospect the performance characteristics demonstrated by the 
reliability growth models examined suggest that as a model is employed 


the estimated reliability progress path it produces be compared with the 
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appropriate model accuracy performance graphs in chapter lll. If the 
estimated reliability progress path corresponds to a case for which the 
computer simulation performance results show the model's performance 
was good, then confidence can be placed in the estimated progress path. 
Оп the other hand if the estimated path corresponds to one of the 
anomalous cases where simulation results revealed a deficiency in the 
model's performance, then the simulation performance results at least 
give an indication of which direction the true underlying reliability 
progress path lies. 

Finally, although use of the continuous instantaneous failure rate 
reliability growth model is questionable, since the test data required 
for the instantaneous model is identical to the data collected for the 
continuous cumulative failure rate model, application of the instanta- 
neous model simultaneously with the cumulative model utilizing the method 
described in the preceding paragraph may provide some insight to the 
shape of the true underlying instantaneous failure progress path from 
the instantaneous model. But the comparison performed between the two 
continuous failure rate models definitely indicates that the cumulative 
failure rate and instantaneous failure rate models! parameters not be 


interchanged based on their hypothetical equivalence. 
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APPENDIX A 


Derivation of Ordinary Least Squares Regression Estimates of the 
Continuous Instantaneous Failure Rate Reliability Growth Model Parameters 


The continuous instantaneous failure rate model reliability growth 
model as given in equation 3.37 may be written as 


h = шини | (A. 1) 


Taking the logarithmic transformation of this equation yields 


Їнэ 


In b(l-a) - a In TT. Е (212) 


Let n 


p o: 


i=] 


-< 
II 


[ης 


Ї | 


>< 
I! 


In TT; x 


Y ш-------, апа 


Therefore, 


-< 
I 


In b(l-a) - ах, (А.3) 
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The residual error for regression is 


eae Y. - [In b(l-a) - ах. | : (А.А) 


The goal of the regression is to minimize the sum of the residual errors 


squared; i.e., 


min Жы ш М ao = Del Ь(1-а) + π᾿ 


(A.5) 


Taking partial derivatives of equation A.5 with respect to Ы апа а; 


then equating the partials to 0 yields the following two equations in 


two unknowns: 

(1) 9 € ᾽ 
ES 
ob 


(2) 9 Eu 
да 


$ (2 (Y, -In b(1-3) * ax (- z | des) 


-а 


| 
© 


ША ] 8 
ра ο ο ο а DAN о 
Simplification of (1) and (2) yields in sequence: 


ШІ!) 
DE. - in b(l-a) * aX,] = 0 , and 


22) 
X U [(Y, -In b(1-a) + aX) (SF t Xi)] sO. Then, 


a) Зу E > n b(l-a) - > ах, : 
m.) 


ӛте US E шик E Y > IS 287 Іп Ь(1-а) - 


E. БЫ: Finally, 





ШІ!) pov. ΠΡΙ = а 5 Ге апа 


(2111) тт ΣΝ. T pane = Tray | P =a) + (jn 5 (І-а)) » - 


a 2 
Teay UK 2 DX 
Equation (1''') may be manipulated such that 


] 3 - - 
uU in b(l-a) Е > Y. a ) X. Y + aX or 


(ша) b(l-a) = exp (Y + ax) 


Finally, the estimate for b is 


σ) 


тат өр (7% 25). (A.6) 


Substituting equation A.6 into (2''') yields 


πη) — 221 T 7% AO) Er τ. (1-a)] T 


— (1-а)1 7X, - ЕРІ 2x HE Ix 


Clearing the logarithms in (2'"') and transposing leaves 
TIEN, n 7 Y 7 Y = а = 2 2 
(0и) траур (ад) + (най ΣΧ 23:73 20 


US Ж» $^ vi X 


EXoanding (2'"'') yields 
EN ey Ж X. * aX > x = ΟΣ. - 
(1-a) (1-а) 1 Ї (1-a) 1 


a ΣᾺ - — DRY. = par xe 


ZA 





Substituting and clearing terms in (2*) leaves 
ү; | а Y X E - 
НӨ X5 *is 225** Xn 22cm IN, 
2 1 
a Km ШЕГІ! a, γι, 
Solving for a in (2**) gives 
ale ate a's Y - 2 = - Y 
— 3052, δη 
prx - Y X. 
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